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ABSTRACT 

Some observations ar. offered about alternative 
assessment devices, performance assessments in particular. The act of 
conducting alternative assessment does not automatically ensure good 
assessment. Users must become knowledgeable consumers of published 
alternative assessment tools and developers of local and classroom 
assessments. Performance and other alternative assessments are a 
useful part of the assessment arsenal; they must be carefully 
integrated into large-scale assessments and the public must become 
educated consumers of the information offered by alternative 
assessment. Annotated bibliographies of 117 articles about 
alternative assessment gathered by the Test Center of the Northwest 
Regional Educational Laboratory are included in the following areas: 
(1) mathematics; (2) reading; and (3) portfolios. Charts summarize 
assessment instruments, anthologies, achievement tests in speaking 
and listening, and educational agencies interested in alternative 
assessment, criteria for selecting and reviewing assessment tools in 
speaking and learning are also summarized in tabular form. (SLD) 
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Introduction 



The Test Center at NWREL, estat)lished as part of our OERl latwratory funding, is a lending library of 
assessment Instruments and a source o# technical assistance to educators In the Northwest. In support of 
our lending function, we make systematic collection efforts In several chosen topical areas each year. 
These result either In a "Consunw Guide" -- a description and review of the assessrrwnt tods available in 
the area - or an annotated bibliography. 

Test Center staff have made systematic coilection efforts In the areas of assessment Instalments for 
measuring higher-order thinking skHls, school and classroom dlmate. self-concept, student motivation to 
leam, writing, speaking and listening, leadership, early childhood education, screening students into TAG 
programs, and alcohol/drug use surveys. Over the last two years we have also been gathering Infomiatlon 
on alternative assessment devices. Currently, we have In our collectkyi over 75 titles in the area of using 
student portfdtos for assessment, 25 titles relating to assessment alternatives in reading, and 15 titles 
about assessment altematlves In math. 

Annotated bibliographies o* these alternative assessment devtees are continually being updated and are 
available upon request from the author. Oth.er Consumer GukJes and annotated bibliographies are 
available from NWREL and ERIC. 

All the Instmments and artides In the Test Center. Including the- large collection of assessment alternatives 
are available for inspectton to educators in the Northwest on three week loan, through the maB. This is an 
inspectk^n servtee only; once a person has deckled on an assessment tod, he or she is Instmcted to 
contact the author or publisher. This has been a free sen/k», supported in the past by OERl, and soon to 
be supported In other ways. Last year we circulated over 2000 titles to over 500 IndlvkJuals. 

In addition to the lending library and Consumer QuUe functtons. Test Center staff prc-^e technteal 
assistance In assessment to an addlttonal 200 callers a year. Tills assistance ranges from help with 
converting scores on norm-referenced tests, to helping people And sources of ll9m banks, to nxxe recent 
keen Interest in assessment alternatives. 

Based on the review of a large number of assessment Instruments, the systematic effort to track down 
assessment instruments in a number of topical areas, and discussions with a large number of end users of 
assessment tods, I wodd like to offer the fdlowing observations about alternative assessment devices In 
general and performance assessments in particular. 



Paper presented at the annual meeting of the American Educational Research Association, Chicago, 1991 . 



BEST COPY AVAILABLE 



Misconceptions About Pert ormanco and Othar Altarnatlva Assassmants 



The message Is not getting out clearly enough to test users that just doing ^alternative assessnrtenf does 
not automatically imply doing 'good' assessment. Good assessment requires that we have a dear 
conception of the target we are trying to measure, we have a dear purpose for the assessment, we have 
chosen the assessment technique that best matches the target and the purpose, and that we have 
minimized factors that could lead to a misinterpretation of results (Stiggins, 1990). 

Common misconceptions ^ the field are that (1 ) doing performance (and other alternative) assessments 
wiii automaticaliy result in better assessment: (2) anything qualifies as an alternative assessment; (3) aii 
structured format tests are bad and only alternative assessment devices should be used; and (4) using 
alternative assessments wll automatlcaiiy solve all of our assessment problems. Here are some examples 
that demonstrate the existence of these misconceptions: 

1 . i was astced to comment on a Guidebook that was being developed to accompany a large- 
scale video conferer)ce on assessment to support restructuring. The original draft 
contained comments lii<e: 'A subgroup of performance-based assessments are called 
exhibits or exhibitions. Exhibitions are authentic and engaging lests' of students' 
intellectual ability, where students have opportunities to 'show off what they know, and 
the contrd they have over n topic. Students must approximate an expert's abRRy to make 
informed judgments and to use knowledge effectively...;* and 'MultMimenstonat 
assessments enable secorxi language users arxJ students with special needs to look at 
more naturalistic sources of Infonnatton. They increase special need students' incentive to 
learn, to take risks, and to overcome their own weaknesses...' 

The feeling In the original draft was that doing performance assessments would 
automatkally ensure that all the wonderful things listed in the above statements would 
come true. There were no cauttonary notes, and there was no seeming realization that 
these things would only come true if the assessments are done well. (In all fairness, the 
sponsoring organlzatkm was also uncomfortable with the first draft and sent it out to a 
number of reviewers. The final draft is somewtiat different.) 

2. Anything seems to qualify as an 'alternative assessment.' For example. NcREL (1 990) 
indudes many examples of new assessment strategies. A number are of this type: 'At the 
end of a unit, students write a paper for another dass of students (younger, dder. or the 
same age) explaining the concept. Example: Sixth graders write a book for fourth graders 
explaining the cyde of a star' (p. 1 6) 

Why is this assessment? To qualify as assessment, criteria or a method for evaluating the 
final product are needed. How does the teacher know if the students dki an adequate job 
of writing this book if there are no criteria? How do the students know how effective they 
were and what might be done differently next time? How can the prodixn be critiqued? 

This example also Rlustrates the misconceptkxi that 'alternative' assessment automatk:aiiy 
implies better assessment, and that alternatives wll soK'e aN our assessment problems. 
But. how do we know that this task realty dldts what the student knows and can do? How 
does the abllty to write affect the student's abllty to show understanding? 

3. A lot of the portfdk) literature also @eems to reflect the misconception tfwt 'alternative' 
assessment is automatk^llyb^dr. Many papeni that describe portfdtoe systems do not 
indude criteria for assessing either the IndMdual entries In the portfoik) or the portfolto as 
a whde. Addltk)nally. although many portfoik) systems require student self-rellectk>n on 
their own wori(, there are few examples of criteria to evaluate these metacognittons. 



There are, of course, some notable exceptions, such as Vermont (1969 & 1900), Mumme 
(1990), and Juneau (1969). There are also many such rubrics for assessing writing 
samples. However, those using writing portfolios In Instruction seem (nathe to use them - 
as If the process of evaluating a student performance diminishes Its worth. (The problem 
might be :hat teachers tNnk of evaluation as reducing t complex student performance to a 
«^ ^nle .lumber, when actually, having criteria means having an agreed upon and 
systematic basis for Icnowlng what to value in a performance.) 

The Reality of Performance and Other "Alternative" Assessment Approaches 

Perfomiance and other alternative assessments certainly have a place in our assessment tool idt. They 
dearly have the potential to assess many types of things that are difficult to measure In fixed response 
tests. The issue is not so much whether to use them, but to help users to realize that they have to be good 
consumers of published tools, and knowiedgeabie developers of local and classroom assessments. 

In actuality, if not done well and Interpreted properly, performance and other alternative assessment 
devices can mislead as much. If not more, than the results of tradltionai' O-^- choice) tests. As has 
been pointed out elsewhere (Rothman, 1990; Valencia, 1989), performance assessments are based on a 
small number of tasks (and therefore may not be a representative sample of what a student can do), and 
can be subject to the individual biases of those rating the performance. Additionally, the criteria used to 
assess performance may not reflect the most relevant or useful dimensions of a task, the tasks that a 
stijcicnt is asked to do can make one wonder what it Is that Is 'autheritic* atXMJt performance assessment, 
and thert» may be things in the perf onnance assessment that makes a student unable to really demonstrate 
what they know or can do (Arter, 1989). Users may not understand these limltattons and may, as a result, 
both misinterpret the results of, and design poor performance assessments. 

For example, in the Oregon writing assessment five different modes of writing are being assessed: 
personal nan^tlve, descriptive, imaginative, persuasive, and expository. Prompts that invite these types of 
writing are randomly distributed in classrooms so that all modes are addressed in each classroom. 
However, any given student writes only one essay. A major effort is underway to inform users of the 
assessment results that one cannot make inferences about indivkluai students' abHIty to write t>ased on this 
one sample. Although this makes sense to people when It Is pointed rjut, they seem to be almost 
universally surprised and disappointed that this pefformance assessment has such a limitation. There is 
certainly the potential for overgeneralizing the results. 

Another example of a performance assessment that couM mlsleari users is porttons of the TTie English 
Langueg9 Skills Profile (Hutchinson and Pollitt. 1967). One part jf this assessment devtee is a stnjctured 
discusston. The students are given an emergency scenarfo and are given 15 minutes to decide In a group 
what they are going to do. The dlscusston is tape-recorded anri the students analyze the tape to assess 
the contributk>ns of indlvMuais to the discusskxi. The students, categorize IndMdual ccmnwits using a 
scheme that includes such things as managing the dIscusskTr. Introducing new ideas, clarifying or 
summarizing kleas, seeking darlftoatkm, etc. 

The questions that arise with respect to this activity is the ex'ient to whtoh we elteit Veal" student abllties. in 
other words, is this an authentk; (valU) assessment? Does ihe task really reflect something we have to do 
In daily life? Wouid students be motivated in the same way to perform on this task as they would during a 
real situatton in their lives? Are the behavkvs elk^lted from students representative of their ahSK> to 
discuss? What about discusskxis in larger or smaller groupe? Or, dis(;ussk)ns with adults iiiStead of 
peers? 

AddKbnaliy. the discussion task requires a certain amount of reading on the part of the student. This is an 
example of how extraneous perfonnancc requiremento rnlght affect student performance on the dlmenston 
of interest. Do we have any Infonnatkm about how the aMIty to read or role play might affect perfonnance 
in the discusskm? 
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A third exampi* of how designino or ufioQ alt«mattv* assMsmont davicM without thinking through the 
implications of thair use (x>mM from thaarM of oral conmjnicc^ Most of the assessment devices on 
the market purport to measure abllty to communteate. HoMwr in actuality, the measures systematically 
leave out a large number of the communtoation contexts that woukj be necessary to Include if we would 
truly like to be able to infer, in general, how wal a student communteates (Arter. 1969). For example, 
conskier speaking assessments. Most speaking assessments focus on rating a speech that a student 
gives. Is this really a good measure of how weH a student communtoates oraJly In general? What about 
interactive communteatton In whteh speakers and listeners take turns? Or. communk^kx) with dHferent 
types of groups (peers, teachers, parents, younger chldren, etc.) requiring different levels of fonnallty? All 
communteatton occurs in a context If we dont systematteally sample from the contexts in our assessment 
(and Instructton), we don't really get a tme picture of performance. 

A fourth example of how users need to be careful with respect to alternative assessments comes from the 
area of portfoltos. I am currently woridng with a school district to devetop a composite health portfolto to 
demonstrate how much students are learning, and the degree to whteh heelth kwtn^tton is integrated with 
other subjects. (A composite portfolio Is one whteh contains more than one student's wori(.) The teachers 
wanted to gather real wortt samples to show what students have learned, and wanted to gather examples 
of Instnjctkxiai units to show how teachers teach health. After discussing the types of displays that could 
be collected, the committee began gathering. After sharing what was gathered during the first round, it 
became abundantly dear that what we had was the best of the beef; we coukJ not answer two 
fundamental qu38tk)ns: Do all students learn this much? and Do all touchers do this? The questten of the 
adequacy with whteh the content of the portfdto adequate represents what It is we want to show, is of 
central Importance (Valencia. 1969). 

A flnal example Is the Infomml Writing Invmory (1986). whteh "provkies stoicture for evaluating writing 
samples" to detennlne the "presence, degree, and, to a Iknited extent, the cause of writing disability." 
Composlttons. eltelted by means of 14 pteture cands, are scored by comparing the number of technteal 
errors (spelilng, grammar, capltalizatten, incomplete sentences, etc.) to the number of errors that disnjpt 
communlcatton. Is this really the best measure of writing ability? This assessment does have criteria to 
judge performances, but does It have tfre right criteria? 

I chose this final example because It Is so extreme. But what about more subde examples of criteria that 
might be inadequate? Uke holistte scores on writing assessments? What about the relevance and quality 
of criteria that arise from different theoretteal models? Or those that are developed by IndMduals that 
might not have an expert grasp of a subject area and direct experience with students? 

Implications 

We need to provMe more assistance to users to ensure that performance and other alternative 
assessmems are used well and devetoped property. This is as important for using the results of large-scale 
assessment as It is for classroom use d a published instrun)ent, or even for daly infonnal classroom 

assessment. 

Most alternative assessment approaches have their greatest potential use in the classroom as a Integral 
part of instructton. if teachers do not understand how they can be mislead by pooriy conceived tasks and 
fuzzy criteria, and how extraneous perfonnance requirements can affect student perfonnance, then their 
daily ability to make Judgments about st xient needs and progress wi be Inadequate. 

Addlttonally, there is the danger that If we alkjw users to njsh into use of altemalh/e assessments w^ 
thinking through their assessment needs, how aiteniatlves fil into these needs, and what potential problems 
they might encounter, they couM very likely be confused and disappointed when the alternative 
assessment does not fUflU their expectattons of -Ibdng-aM assessment problems. We want to avoU having 
people njsh headlong into alternatives only to have them later rejected because they don't wort( 



Pdtformance and other altamativ* assMsment approtchet art too useful a part of our assessment arsenal 
to allaw this to happen. We need to ba cautious about ho^ wa integrate them Into larga-ecala assessment. 
We especially need to give proper guidance (and additional undergrsduate training) to teachers and school 
administrators concerning what good assessment is. and how and when various typM of assessment 
approaches are best to use. And, we need to educate the public about alternative ways of icnowing, so ttiat 
they can be good consumers of assessment Information. 
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Math AM«Mm«nt Alttmatlves 
Fabruary1,1M1 




The foliowing artldM raprMant what Tast Canter staff have found so far regarding assessment alternatives 
in mathematics. Presence on the list does not necessarily imply endorsement. Many of the entries are 
informal assessments, and are intended mainly for the classroom. For more Information contact Judy Arter 
or Ann Davis at 503-275-9562. Northwest Regional Educational Laboratory, 101 S.W. Main. Suite 500. 
Portland, Oregon 97204. 

Arizona Student Assessment Plan, 1990, Donna Campbell, 2102 W. Indian School Rd., 
Phoenix, AZ 95015, 602-264-1774. (TC0O6O.SARISTA) 

The Arizona Assessment Program nas several parts: a short standardized achievement test, non- 
test indicators, and performance assessments In reading, math and writing. The performance tests 
are designed to measure the state's Efsential SkMs. The math portion presents an extended 
prot>lem solving situation tfiat requires short answers, extended answers, and explanations of 
answers. Each extended exercise has Its own specific set of scoring procedures that involve 
assigning a point value If various things are present in the response. 

California State Department of Education, A Question of Thlnldng, 1989, 721 Capitol Mall, 
P.O. Box 944272, Sacramento, CA 94244-2720, 916-445-1260. 
(TC*600.3AQUESO) 



This report describes the results of I2th grade student performance on open-ended math 
problems. This assessment was part of the Cailfomla Assessment Program (CAP). The open- 
ended problems were scored using rubrics developed for each problem. These rubrics are 
described, and 'anchor* papers for the six scale values for each njbric are provided. Although 
there is a separate rubric for each problem, they are all Intended to reflect the foliowing dimensions 
of problem solving: understanding of mathematics, use of mathematical knowledge, and ability to 
communicate about mathematics. 

Charles, H., Evaluating Progress in Problem Solving, The California Mathematics 
Council, Communicator, 14 (2), December 1969, pp. 4-6. (TC0SOO.3EVAPRI) 

This artldee presents a rationale for analyzing student open-ended problem solving In a systematic 
fashion. One sample anatydcai acoring aibric Is presented. The traKe are: understanding the 
problem, planning a solution, and getting the answer. The author also proposes some other 
questions to ask as one looks at student problem edvlng attempts: DU the student seem to 
understand the problem? Were the appnsaches used to solve the problem feasible for finding a 
solution? Does the answer make sense in terms of the questkxi to be answered? 

Department of Education & Science, Great Britain, Mathematical Development, 
Secondary Sun/ey Report # 1, Assessment of Performance Unit, 1980. (As 
reported In Grant Wiggins CLASS training materials, 1990. Contact author for 
information.) 

The scoring/recording system for open-erxJed math problems uses a scale that reflects the 
amount and type of prompting required In order to elicit a correct response from the student. 
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EQUALS, Assessment Alternatives in Mathematics, Lawrence Hall of Science, University 
of California, Berkeley, California 94720, 1989, 415-642-1823. (TC^500.6ASSALI) 



This document provides an overview of some possible assessment methods in mathematics that 
cover both process and products. Specific examples are provided for writing in mathematics, 
mathematical investigations, open-ended questions, performance assessment, observations, 
interviews, and student self-assessment. Any of the student generated material coud be self- 
selected for a portfolio of work. The document also includes a discussion of assessment issues 
and a list of probing questions teachers can use during instruction. 

Grobe, R.P., Cline, K., andRybolt, J. Curriculum Based Assessment For Math: A 
Summary of 1990 Field-Test Results, Ml Diablo Unified School District, 1936 
Carlotta Dr., Concord, CA 94519. (7C*500.3MrDIAC) 

The pilot project in Mt. Diablo school district entailed scoring open-ended math problems 
holistically for grades 3. 5 and 8. The hoiisUc scale (0-4) defines an exemplary response as - 
systematic or elegant, organized recording system, complG^e and accurate, and clear and 
thorough explanation. One problem along with sample student responses is also presented for 
each grade level. A rationale for using open-ended problems is also provided. 

Lester, F.K. An Assessment Model for Mathematical Problem Solving, Teaching Thinking 
and Problem Solving, 10, 1988, pp. 4-7, Lawrence Eribaum Msociates, Inc., 
Journal Subscription Department, 365 Broadway, Hillsdale, NJ 07642. 
(TC^500.3ANASSM) 

This article presents a model for assessing both the problem solving performance of students and 
assessing the task demands of the problem to be solved. The dimensions of problem solving 
(which could be used as a scoring rubric) are: understanding/formulating the question in a 
problem; understanding the conditions and variabies in the problem; selecting the data needed to 
solve the problem; formulating subgoals and selecting appropriate solution strategies to pursue; 
implementing the solutioi. strategy and attaining subgoals; providing an answer in terms of the 
data In the problem; and evaluating the reasonableness of an answer. The article describes these 
in some detail. 

The problem features that can affect a student's success in solving a problem are: they type of 
problem; the strategies needed to solve It; the mathematical content /types of numbers used; and 
the sources from which data need to be obtained to solve the problem. 

Math Learning Center, Recommendations For Assessment, Visual Mathematics, 1989. 
(Full reference not available. TC05OO.3RECFOA) 

This document is p>art of a longer rrK>nograph. Unfortunately, the longer source was not noted in 
the ver8k>n we obtained. The exerpt briefly discusses using writing activities, checklists, quizzes, 
interviews, and self-evaluation to assess mathematics. The appendices contain a list of writing 
activities, joumal exercises and starters, a checklist covering Important dispositions, interview 
suggestions, and self-evaluation activities. 

Meltzer, L.J. Sun/eys of Problem-Solving & Educational Skills, Educator's Publishing 
Sen/ice, Inc., 75 Moulton St, Cambridge, MA 02138, 1987. (TC0O1O.3SUROFP) 

Although this is a indrvkJual test publish id primarily for diagnosing learning disabilities for students 
aged 9-14, t has some Interesting ideas that could be more generally applied. There are two parts 
to the test ~ a more-or-less standard Indlvkjuallzed aptitude test, and a series of achievement 
subtests. The math subtest involves a fairly standard test of computation. However, the word 
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problem subtest requires the teacher to score each proWem on choice of correct operations. 
abHIty to complete the word problem, efficiency of mental computation, self-monitoring, self- 
con-ectlng. attention to operational signs, and attention to detail. 

Another interesting part of this test is that after each subtest is administered, the teacher Is guided 
through an analysis of the student's strategies In completing the task - efficiency of approaching 
taslcs. flexibility In applying strategies, style of approaching tasks, attention to the task, and 
responsiveness during assessment. In the aptitude portion of the test, the teacher also assesses 
the student's ability to explain their own strategies. 

A review in The Reading Teacher. November 1989. concluded that, since there is little evidence of 
valWity presented by the author, the test should be used infomrwiiy, for classroom assessment. 
The reviewer also states: The SPES, rather than attempting to measure underlying cognitive 
abilities, instead appear to emphasize underlying strategy awareness and use. This orientation 
appears to reflect the important recent developments in educational thinking emphasizing the child 
as a problem solver who uses intentionally-selected strategies to improve understanding and 
learning" (p. 1 76) 



Munne, J., Portfolio Assessment in Mathematics, California Mathematics Project, 

University of California, 300 Lakeside Drive, 18th Floor, Oal<land, CA 94612-3550 
1990. (TC^500.6PORASI) 

This booklet describes what mathematical portfolios are, what might go into such portfolios, how 
Itens should be selected, the role of student self-reflection, and what might be looked for in a 
poftfolio. Lots of student samples are provkJed. Criteria for evaluating portfolios include: 
evkJence of mathematical thinking, quality of activities and investigation, and variety of approaches 
and investigations. 

Oregon Dimensions of Problem Solving, Mike Dalton, Oregon Department of Education 
700 Pringle Parkway Salem, OR 97310, 503-378-4974. (TC05OO.3OREDIO) 

The Oregon State Department of Education is cun-ently sponsoring a consortium effort to develop 
an analytical trait scoring system for open-ended math problems. Two versions of the rubric are 
included; the second version Is a modification of the first based on a pilot test. The team is 
cun-ently trying out the second version on multiple problems across multiple grades. The traits 
are: 

1 . Conceptual understanding of the problem 

2. Procedural knowledge 

3. Problem solving skills and strategies 

4. Communication 

The cun-ent version includes a scoring gukJe for each trait. The ultimate gc«l Is to develop a 
package that also includes anchor perfonrwnces, although these are not y»rt included. 
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Schoenfeld, AH. Teaching Mathematical Thinking and Problem Solving, in Toward The 
Thinking Curriculum: Current Cognitive Research, LB. ResnlckA L.E. Klopfer 
(Eds), Association for Supen/lsion and Curriculum Development, 1989. 
(TC05OO.5TOWTET) 

Although this article is more about defining what mathematical problem solving is than about 
assessment, it presents an interesting visual way to represent how students spend their time when 
solving a protJem; it also compares such a plot for good problem solvers to a plot for an inefficient 
prot}lem solver. 

Essentially, this procedure involves tracking the sequence in which students use different steps in 
the problem solving process (reading the problem, analyzing the problem, exploring a solution 
strategy, planning, implementing a strategy, and verfiying the results) and the amount of time spent 
on each. Good problem solvers spend a lot of time analyzing and planning, with many self-checks 
on *how it is going.' Poor problem solvers tend to fixate on a possible line of attack and pursue it 
relentlessly even when It is clearly not going well. Additionally, there are very few stops to self- 
check on hew It is going. 

Vermont Mathematics Portfolios, Vermont State Department of Education, Montpelier, 
Vermont 05602, 1990. (TC*500.3VERMAP) 

TMs document describes the portfolio pilot currently being conducted by the state of Vermont. 
Criteria for evaluating portfolio entries include: defines the problem, applies strategies logically, 
verifies results, interprets results, makes connections between equivalent representations of 
mathematical concepts, shows facility with mathematical notation, communicates mathematical 
thinking, and communicates mathematk^l disposition. Entries are also analyzed for dispositions 
motivation, curiosiiy. perseverance, risk taking, flexibility, and self confidence. 

A sample of portfolios are examined for evkJence of student growth, emphasis on concept 
development, development of group problem solving skills, integration of mathematics into other 
curriculum areas, application of math to real-worid experiences, and making math connections. 

Wells, B.G., Journal Writing in the Mathematics Classroom, Communicator, September 
1990, 15(1), pp. 30-31. This is the journal of the California Mathematics Council, 
Ruth Hadley, 1414 South Wallis, Santa Maria, CA 93454, 805-925-0774. 
(TC*500.3JOUWRI) 

This brief articles describes one method that a teacher uses to elicit thinking on the part of high 
school math students. The teacher puts a short phrase on the board at tho beginning of each 
class period and students write what they know about that phrase as the teacher takes attendanco 
Sample 'prompts' and student responses are included. Although no criteria for evaluating 
responses is included, this article is added here because It represents an attempt to do writing in 
nruith. arxJ because some of the prompts are designed to elk;it metacognitton, e.g., "What three 
problems on the final should have been eliminated and why?" or "What mathematical fact, concept, 
skill or Insight that you leamed in this dass this year are you most likely to remember and why?" 



1 1 




READING ASSESSMENT ALTERNATIVES 
JANUARY, 1991 




The follOM^ aitlclM r«pr«Mm ¥^ TMt Canttr fltaff hi^ 

InrMdmg. PrvMOM on the IM dOM not rwcMsarly imply endorMn^ Many of the entriee are Momi^ 
assatsments. and are Intendfd mainly for the dasenxxn. For mora m fo mw tl on contact Judy After or Ann 
Davis at 503-275-9500. Northvvett Regional Educational Laboratory. 101 S.W. Main. Suite 500. PoiUand. 
Oregon 97204. 



Arizona Studant Assassment Plan, Donna C9fnpball, 2102 W. Indian School Rd., 
Phoenix, AZ 95015,602-264-1774, 1990. (TC4^060.3ARI$TA) 

The Arizona Aaaeaameni Program has Mveral parts: a short standaidteed a ch ievement tea. non- 
tett indictws, and perfonnance a s sessment s in raadlna math and wrMng. The perfomwnce tests 
are designed to msasurs the state's Essential Skua. The reading portion um a single extended 
passage for each teat The students begin wKh a prareadinoactMty such as tMnMng about the 
historical contaKt of a selection. Then they read the selection and anawer a series of questions: 
multiple-choloe, short-ansMMr. and writing paragraphs analyzing the woric 

Each extended exercise has Its «Mm specific of scoring criteria that Involve assigning 
depending on whether various features are present in the response. 

Assessing Reading In Illinois, Illinois State Board of Education, 100 North First Street, 
Springfield, Illinois 62777-0001, 1989. (TC4^440,3IUQOA) 

This sst of documents describes the innovative llUnols state rsadlng assessment. Important 
aspects of the assessment indude: 

1. Use of whole selectiona. 

2. Ouastioneiboutprtoriiudanitoptetenanty. 

- . ^ , .'1,. 

3. QuesttonaatoottlhafiKfingstrateglaaiCudaniausa.^- 

4. Ouaatlona about Sudanis' meracysKperienoea. 

Bailey, J., af^S$b«pm «Mv Our Way to AttemiM Bmhmtfon Procedures, 
Lan gm l/l mm, m,Apm IOBB, pp. 304-373. (TC*400.3PROSOO) 




This ai^^^aiiMa aami taacharHleveloped sk«s checMto In raadl^ 

Barrs, M., Ein8,% neemi Hi'MThonas^A The Prtma/y LMnguaae Record Handbook 
idr Teachers, Cmt^fof Langikge In Pt1m[y Bdudalfan, Webber Raw, London 
SE180W. Also anmllabtefroinHelnenmnnEdiKitidnaiaoof(S Inc., 70Court$t., 
Portsmouth, NH 03801,. 1988, (T€t070.3PRIlAR) . . 

The Primary l^nguapallaootd(PIJ) has the fatowing 

1. it collects perfonnaneeaamptia from students at severe pomu In time. Both mformatton 
to coNact and the time frame are specNIad. 
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2. ltpromotMim^ratk)nofiit«racyandlimguig«acroMth«cun1^ 

3. it invotvM parants and ttuderns in discussions of the student as a ianguage user. 

4. It Is an informal assessment designed for use in the dassroonn. 

Part A of the PUH should be completed at the beginning cH the school year and sections tor student 
demographics and notes concerning discussions with parents and students. The manual provides 
suggestions for discussbn topics. 

Part B of the PU) is completed during the second semester of the school year. It has sections for 
maidng open-ended notes about the student's talldng/listening, reading and writing. There is a 
&upplementai 'ObteivaUons and Samples' sheet that the teacher can use throughout the school 
year to recordbifbrmation that might be useful for completing Part B. TNs Is essentially a teacher- 
generated portfolio for each student that contains observations of speaking, listening, reading and 
writing: and samples of student reading and writing. There are suggestions for how to organize 
and store this Information as well as what to record and how to use the Information in Instruction. 

Part C is completed at the end of the school year and has space for commento by the student's 
parents, notes on a student conference, and information for next year's teacher. 

Carver, R.P. Rauding Efftcfency Lave' Test, Revrac Publications, Inc., 207 W. 1 16th St., 
Kansas City, MO 64114, 1987. CrC044O.3RAUEFL) 

The Rauding Efficiency Level Test (RELT) is an Individually administered reading test that 
determlnee the most dlfWcult material that an Iridlvldurt can coinprehen d v^ 
that >s appropriate for the dMficuRy level of the matorWs. Comprehension is defined as 
understanding at least 75% of the sentences In the passage. 

C/ar/f, C.H. Assessing Free Recall, The Reading Teacher, 35, January 1982, pp. 434- 
439. (TC044O.3ASSFRR) 

This document describes a procedure for aseeealng how much of a passage a student remembers 
and the relative Importanoe of what la ramambMad. The teacher braak|,apM8age into pausai 
units and assigns animpoftano number to each unit After the student reads the passage slentiy. 
he or she reiels evaryiNno ha or aha lamarnbaii. The teacher JMIcataa the aaqua^ 
a woricsheet and analyM the aimtunt recalled, the sequence of recall and the level of imporianM 
of the recalled material 

Degrees of RmanqPomri Touchstone Applied Science Associates, Inc., Fields Lane, 
P.O. B^^, ^mmtnr, NY m09, 914-277-4900, 1985. CfC044O.3DEQOFR) 

The OM^jtior Itelino PoMa^ 

seveniRtfHMamlsalng. Btudama must select the word that beat oompletaa the meaning of each 
mcomplMifariianoaL ThaMlorMlalathiiiatudertfsmu8tunderatandtha«Ktendedoonta)aofth^ 
passage In ordar to aalecl the oofrad words. TMtlsnotavmb^tMt Thafiaat ldentMesthe 
hardest proaa thai pupte can read with dMsrantlavela d oomprahi^^ 

Fagan, W.T., Jensen, J.M., and Cooper, C.R. Measures for Research and Evaluation in 
the English Language Arts, vol, 2, Nationat Council of Teachers of English, 1111 
Kenyon Road, Urbana, IL 61801, 1985. (TC0MEAREE2) 

This booi< cor«(ains a number of scoring guides for assessing various targets in reading, literature, 
writing and oral communication. 
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Fan, R. and Cany, R.F. Raadfng-WhatCanBeMaasund? tntamattoni Reading 
Assodatton, 800 Barksdale Rd., NawarK DE 19714, 1086, (TC4^440.6REAWHC) 

This book to arttholooy of aitldM concerning tMUM 

guidtlinMlcf tht impravtd um of rwdtno tMts. trtndt h asMMing rtading. and vartous ways to 
asset* raadlng comprahanatoa word racognMon, vocabulary, atudy akMa. and raadlng rate. 

This book Is rnore a raviflw of iMuat and procaduraa than datalad inamjctk)^ 
using a given approach. 

Flood, J. and LaM, D. RaporUng Reading Progress: A Comparison Portfolio For 

Parents, The Reading Teacher, March 1989, pp. 508-514. (TC4i^400.3REPREP) 

This article deacdbea the cortent of a reading (and writing) portfolio for each ttudent that can be 
used to show progress to parents. 

Glaser, S,M., Searfoss, LW., and Gentile, L.M. Reexamining Reading Diagnosis New 
Trends and Procedures, international Reading Association, Newartt, Delaware 
19714, 1988. (TC044O.6REARED) 

This book Is a compendium of articles covering a variety of toplca. This reviewer found the 
folfowlng of moat uae: using student ^Nnk alouds* to analy2e reading straleglea and self • 
monitoring (p. 94); checdlita for developmental stages In early reading and writing that can be 
used to analyze student progress (p. 48): Mbrmafly momtorlng student knowledge of xwt 
stmctures (p. 103): and a checklist for analyzing student rsieling of stortee (p. 139). 

Johnson, M.S., Kress, RA., and Pikuiskl, J J. Informal Reading Irwentorles, Second 
Edition. International Reading Association, 800 Barksdale Road, Newark, 
Delaware 19714, 1987. (TC044O.6INFRBI) 

This book describes how to develop administer and score infotmal reading inventories. It does not 
review existkig Inventorlea. 

Kletden, S.B. and Bednar, M.R. Dwiamic AsaesamentldrAt-Risk Readers, Journal of 
Reading, April 1900, pp. 528-533. (TC4^DYNASF) 

The Oynamk: AsseeamM Procedure (DAP) Involves the folk^^ 

1. An MtWaaaeaamant or raadlng abllty. 

2. Amiyria Of a MxttnTa reading processee and atrategles. 



4. AnrtyHa of the aiudanraabmy to benefit from the m kHeeson. 

Meitzer, LJ. Sunmys of Protilem'SoMng & EducaUonal Skllla, Educator's Publishing 
Senrlce, Inc., 75 Moulton St, Catntirtdge, MA 02138, 1987. (TC*010.3$UROFP) 

Although ihia is a taat pubHM prfmtfly for diagnoaing leaning dl^^ 

14. It has some intafeadngUaaa that ootid be mora ganaiily applied. There are two parts to the 

teat - a fiK)Mr-4eaa sMard iTMfliMuallBad api^ 

In addkkm to daoodkig skis, vocabuiafy knowMga. and the abMy to aapar^a words in a 
paragraph that has no word spacing, the reading subtest also ' equirea an oral retelling of a story 




3. 




of a learning minlesaon for one area In which the student needs assistance. 
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and oral rwpontM to comprehension quMtiora. Th« oral retelling is scored on order of recall, 
amount of recall, and the recall of Important ideas in the passage. 



The moat Interesting part o* this test howevw, is that after each sutxest is administered, the 
teacher Is guided through an analysis of the student's strategies in completing the task - efficiency 
of approaching tasks, ftaadbllty ki applying strategies, style of approaching tasks. attentkNi to the 
task, and responsiveness during assessment In the aptitude portkm of the test the teacher also 
assesses the student's at>llty to explaki their avn strategies. 

A review In The Reading Teacher. November 1969. concluded that, since there is little evWence of 
valUity preserted by the author, the test shouM be used infomnally. for classroom assessment. 
The rvvlevver also states: The SPES. rather than attempting to measure underlying cognitive 
abilities, instead appear to emphasize undertying strategy awareness and use. This orientation 
appesre to reflect the Important recent developments In educatiorwi thinking emphasizing the child 
as a problem solver who uses intentkyiaily-selected strstegles to improve understanding and 
learning' (p. 176) 

Paratore, J.R., and Indrisano, R. Intervention Assessment of Reading Compn^hension, 
The Reading Teacher, April 1987, pp. 778-783. (TC*440.3mASO) 

This article describes an assessnDent procedure designed to both assess a student's present 
perfonnance and to discover the faclHy with whteh a student can be taught The procedure 
examines the student's aUlty to employ reading strstegles (such as using background knowledge 
to predtat passage content and using knowledge of passage structure to akj comprehension) both 
independently, and with modeling. If needed. 

Phillips-Rlggs, L Categories of Infarencing Strategies (1981), In Measures for Research 
andh^uatlcnln the Ermllsh Language Arts Vol. 2, W.T. Fagan, J.M. Jensen, and 
C.R. Cooper (Eds.), NCTB, 1111 Kenyon Rd., Urbane IL 61801, 1985. Also ERIC 
ED 236 667. (TC044O.3CATOFI) 

This procedure requires students to read up to a certain point where an inference is required. (This 
point is determined by the axamkwr.) The student is then asked to teM what is happening and what 
may happen next Rasponses are analyzed ki terms of the strateglea used. The ten strategies 
suggested by the author induda: analyzing aftematlVM, confhming an immediate prior 
interpretatkNi, shMng focus, and assigning an alternative case. 

P//fu/s/c^^,/j.^^fom^/?^|n^ The Reading Teacher, March 1990, pp. 514- 

This artldadasccribes the latest edltk>ns of four popular informal reading inventories: Analytic 
Readlnglryatiory (AR1-I0e9). Bask: Reading Inventory (BRI-igeS). Classroom Reading Inventory 
(CRI-lfp. and Informal Reading inventory (IRI-6R-198Q). The author feela that the IRI-BR and 
the ARI Imiha greatest breadth of assassmere rnatariais; tfwt the ARI would be the inventory of 
choice for an amiilnar who wants to asaaas acisfwe and aocW studiee; the w^ 
disabled readara; and the iRi-8R is best for aaseseing reading beyond grade nine dHlteulty. 

Pumphrey, P^. Reading: Tests and Assessment Techniques, Second Edition, Hodder 
OvSSo^lRSKm^ Ownfon Graea Sevomjate, Kent, England, 1985. 

This book is mainly a bibltography of current reading tasU - readiness, achievement, diagnostic, 
and attitudes. However, there la an Interesting sectton on Infonnai reading Inventories and miscue 
analysis. 
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Rea, D.W. and Thompson, D.K. Designing Transformative Tests for Secondary iJterature 
Studeme, Jouma/ of Reading, 34(1), 1990, pp. 6-11. (TC4^440.6DESTRF) 



The authors maintain that cunwn tasts of raading comprehension do not correspond to cun-ent 
theories concerning hoMv meaning is constructed from text. They propose designing open-ended 
questions for studsnts that are baaed on entire rsading ssisctions rather than ahoit passagea. 
These open-ended questions repressnt three levels of comprehension: literal. Interpretive and 
applied. Examples of such questions are provided for three reading selecdons. Some criteria for 
evaluating the responses d students is also indudsd. For example, students' responses to a 
persuasive question could be evaluated for plauslbllty, rslevance. darity. organization, and detaH 
of the supporting material. Criteria are, however, not defined in detal. 

Schmitt, M.C. A Questionnaire to Measure Children's Awareness of Strategic Reading 
Processes, The Reading Teacher, March, 1990, pp. 454^1. (TC*440.3M£TSTI) 

This artide describes a 25-ltem survey/teit which sslcs students about their loiowledgs of reading 
strategies. 

Thistlethwaite. LL Critical Reading ForAt-Rlsk Students, Journal of Reading, May 1990 
pp. 586-593) 

This artide Is primarily about strstegies for teaching critical reading sIdNs to at-risk students. (The 
same proceduree ootid be ueed for any popiiatlon.) It is indudsd hera beceuee it presents 
several checidistsafcritsria for assessing the believablity of infonnation. These could also be 
used for self-reAection or for feedbacl( to peers. 

Valencia, S., Pearson, P., Peters, C, and Wlxson, K. Theory and Pnctice in Statewide 
Reading Assessment Closing the Gap, Educational Leadership, April 1989. 
(TC044O.6THEANP) 

The authors report on two state assessments in reading that they feel is more reflective of current 
research on reeding than the assessmer« approachee of moat cunent standardizsd achievement 
tests. They report that the currant visw of reading suggests that: 

0 Prior knowledge lean Important determinant of reading c omprehei w ion. 

0 Naturally oocunlngtaKtshavetoplcai and structunrf Integrity. 

o InfererMal and Oftleal rsading araaeeentW for constnjcdngnrieaning. 

0 Raading rsquirss the orchestraiton of many raading sklls. 

o 8MM readers apply metacognitlve strategies to monitor and comprehend a variety of 
MSfor a variety of purposes. 

0 PMMvehsMs and attitudes affect 
raading Instructiofi 

o Sklied readera are fluent. 

The authora feel that cunent standardized achievement tests do not rsflect this body of knowledge 
whMe the two state as s e esm ents make an attempt to address thseeissuaa. Each haa four parts: a 
primary test component using a fiii-length selectkxi that measures constructing meaning; a 
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MCtion to MtMt topic famltarlty: qutitlons about 

readlnoalttudM, habits and siif-p«rcaption6. A taxonomy of sidHt/ditpotitiona In thoM areas is 
presantad. HoMMvar, the tasts are stUIn structured fonnat: muitlple-choica. etc. 

Valencia. S., McGlnley, W., and Pearson, P.O. Assessing Reading and Writing: Building 
A More Complete Picture, in G. Duffey (ed.), Reading In the Middle School, 
Newark, DE: IntematlonaJ Reading Association, 800 Barksdale Road, Newark, 
Delaware, 1969. CrC04OO.3ASSREA) 

This paper emphasizes the importance of collecting a large number of samples of student 
perfonnance that represent a wide range of contexts. It describes the dimensions along which 
tast(8 dtffer. so that the teacher can be sure and obtain a good sampling of performance. 

Wade, S.E. Using Think Alouds To Assess Comprehension, The Reading Teacher, 
March 1^, pp. 442-451. (TC044O.3REACOA) 

This article describes an informal assessment process for assessing comprehension. It covers 
how to prepare the text, how to administer the thini( aloud procedure, and what to looic for in 
student responses. 

White, J., Taxonomy of Reading Behaviors (1980),ln Measures for Research and 

Evaluation In the English Language Arts vol. 2, W.T. Pagan, J.M. Jensen, and C.R. 
Cooper (Eds.), NCTE, 1111 Kenyan Rd., Urbana IL 61801, 19G5. 
(TC044O.3TAXOFR) 

The author preserts a daaalfication system for analyzing the verbal rseponaea of studento after 
reading a short passage. The dasaincatlona include paraphraaing. statements of trouble 
understanding what was read, statemerts that indicate vAm reading strategies the student was 
using, off-tasi( statements, etc. 

Wixson, K.K., Bosky AB., Yochum, M.N., and A/vermann, D.E. An Interview For 
Assessing students' Perceptions of Classroom Reading Tasks, The Reading 
Teacher, January 1984, pp. 347-353. (TC*440.3ANItnr) 

The Reading Comprshenalon Interview (RQ) has 16 open^ndod questions that explore. 

1. The students peroapfflon of the goal/purpose of reading actlvitiaa. 

2. The student's undarvtanding of different reading tasicrequiramarts. 

3. TIM strategies which the reader reports using when engaging in various reading tasks. 
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The following articles were obtained from a number of sources Including consortium efforts by the 
Northwest Evaluation Association (Allan Olson. 503-624-1951) and the state of Alaska (Bob SIkerman 

907-465-2865), 

Articles are available for three-week k>an to educators in the Northwest from the Test Center at Northwest 
Regional Educational Laboratory (Judy Arter or Ann Davis. 503-275-9500). We will atterrpt to se!ve 
those outside our regnn as resources permit. 

Articles cataloged as of 12/30/89 

^^!S^Hnn^%1Lt-Si ^1J!]?,^1^'"^ Process, c/o Unda Lewis, Fort Worth Independent 
fTC^470 6&OFR) ^^^^ ^^^^^ 

This is a draft document providing information on using portfolios in writing instmction and 
assessment, rationale, types, content, student self-refleciion. teacher documentation of student 
progress, and goals fo' grades K-5. Included are samples of students' written self-reflections 
samples of teacher analysis of student progress and skills checklists for grades K-5, 

Portfolio Assessment, Kathleen Jongsma, Reading Teacher, Dec 1989- also 

Northside Schools, 204 Prinz St.. San Antonio, TX 78213. '(TC#400.6PORASS) 

This article contains brief statements from three different individuals about the importance and 
use of portfolios for providing a more complete pteture of student progress and ability Two 
statements describe integrated language arts portfolios containing a number of different types of 
indicators. The other describes the use of classroom work samples to supplement a timed writing 
assessment. The article is descriptive; no actual instmments or materials are reproduced. 

Janeau /ntepra/e^Lanot;ap© >*/rs Portfolio For Grade 1, Annie Calkins, Juneau School 
District, 10014 Crazy Horse Drive, Juneau, AK 99801, (907) 463-5015 1989 
(TC04OO.3JUNINL) ^ m^^'/ ovio, ivoi^. 

This document includes both the first and second versions of the Juneau Grade 1 integrated 
language arts portfolio. The 1990-91 version includes: 

1 . Self-reflection A student dictated or written letter explaining why certain pieces were 
selected for the portfolio. 

2. Four student-teacher selected reading samples. 

3. Eight writing samples (four student-selected and four teacher-selected; . A 
developmental scoring gukle is included. 

4. A reading attitude survey. 

5. A speakingaistening checklist. 

6. Teacher anecdota! observations. 
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7. At least one cassette tape of an oral description of something the student has read. 

8. Developmental spelling lists. 

9. Reading logs. 

10. One drawing or illustration per quarter. 

Each student receives an expandable folder which is set up in the following manner: 

1 . The inside front cover has a clip that holds the portfolio definition (the same as the NWEA 
definition), a listing of the items to be collected by each student, a timeline for collecting 
pieces, and a philosophy statement. 

2. Next, there is a slip-pocket for reading samples with a clip on the front holding criteria for 
evaluating student development in reading and criteria for evaluating student attitudes 
toward reading. 

3. Finally, there is a slip-pocket for writing samples with a clip on the front holding criteria lor 
evaluating student development in writing and a writing record sheet. 

Reporting Reading Progress: A Comparison Portfolio For Parents, James Flood and 
Diane Lapp. Reading Teacher. March 1989. 508-514. (TC^400.3REPREP) 

The authors describe the content of a reading portfolio designed to show student progress to 
parents. They suggest the portfolio contain test scores (norm-referenced and criterion- 
referenced), informal assessments (IRIs). samples of student writing at the beginning and end of 
the school year, self-evaluations, and samples of the material students can read at the beginning 
and end of the school year. The article includes a three-question self-analysis of reading 
processes, but does not reproduce sample checklists or IRl's. 

Portfolio Contents. Jill Marienberg. Hillsboro High School District. 3285 S.E. Rood 

Bridge Rd. Hillst)oro, Oregon 97123, 503-648-8561, 1990 (TC^470.3PORCON) 

This piece contains notes that outline a student portfolio in writing, used phmarily for instructional 
purposes. Content includes a letter from the teacher that certifies the work as coming from the 
student, five self-selected writing samples of various types, and a cover letter from the student 
explaining why he or she selected these works. Several complete student portfolios (reproduced 
with the permission of the students) are included. 

The Portfolio Approach To Assessing Student Writing: An Interim Report, Paul Curran, 
State University of New York at Brockport; also in Composition Chronicle, March, 
1989. (TC4470.3PORAPT) 

This article describes a portfolio model used to assess college student writing competence. It 
was patterned after that used at SUNY-Stony Brook. Students submit four essays three after 
revision and one extemporaneous. All essays are part of class woilt and are reviewed by the 
instructor before submission. Each essay ha$ a cover sheet describing the writer's purpose, 
audience, sources and consultants. External readers assign a p: ss or fail. A dry lun occurs at 
mkJterm to let students know how they are doing and to familiari^ ^ them with the process. The 
article also discusses issues, concerns and solutions. The document is descriptive and does not 
include actual student work or rating forms. 
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State University of New York, Stony Brook Portfolio Based Evaluation Program, Peter 
Elbow and Pat Belanoff, in New Methods in College Writing Programs. NY MLA 
1986. (TC047O.3STAUNO) v ^ , l^. 

These two articles describe the use of wrfUrig portfoiios to assess student competertce at the 
SUNY-Stony Brook campus. Each student sutxnits three seK-selected, revised pieces arxj one 
in-class writing sample. The self-selected pieces include: (a) one narrative, descriptive, 
expressive or infonnal essay; (b) one academic essay; and (c) an analysis of anothers essay. 
Each piece is accorrpanied by an explanation of what was to be accomplished by the piece, and 
a description of the process of writing the piece. AR pieces are Judged by teaching staff, but not 
the students' own teachers, as being pass or fail. A passing grade on the portfolio is a necessary 
but not sufficient condition to satisfy the writing requirement at the college. A dry mn occurs at 
mid-semester so that students can see how they are doing. The papers also discuss the 
advantages and disadvantages of the process as weH as what worked and didnl work. The 
document is descriptive and does not include actual student work or rating fomv. 

Vermont Portfolio Assessment Project, Writing Assessment Leadership Committee, c/o 
Geof Hewitt, Basic Education, Vermont State Department of Education, 
Montpelier, VT 05602, 1989. (Taif470.3VERPOA) 

Vermont's draft state writing assessment plan has three parts: a prompted/timed sample scored 
centra'ly; a self-selected "best piece" scored centrally; and on-site review of a sample of student 
portfolios. Single pieces are scored holistically and are used to assess student writing ability 
The portfolio contains all drafts of any piece the student wants to inckide. Portfolios will be 
evaluated on range of content, depth of revision, and students' willingness to take a risk; and will 
be used to evakjate schools' writing programs. A 14-item checklist used to describe portfolios is 
incKided in the document. The document also discusses how to set up a cross-grade portfolio 
system. This involves selecting items for the pemnanent portfolk) from the current year fokJer 
There are suggestions for physical design, cover letter and use in instruction and program 
improvement. 

Vermont is pilot testing its writing and mathematics portfolios with fourth and eighth graders in 40 
schools during school year 1990-91 . The plan is to use portfoltos statewide by fall, 1992 The 
updated portfolio plan for writing that will be used in this pitot is a separate entry in the 
bibliography. (See TC#470.3VERWRA2: Articles catatoged between 8/1 and 10/31.) 

Institutionalizing Inquiry, Miles Myers, The Quarterly of the National Writing Project and 
the Center for the Study of Writing, 9, July 1987, pp. 1-4. (TC^60.6INSINQ) 

This article broadly discusses the level of literacy required for today's world, the need for schools 
to restructure to achieve this goal with students and the implwattons of this for assessment. With 
respect to the latter, the author proposes: portfolios containing all of a student's work; learning 
togs; teachers periodicalty reviewing portfolios to develop a collective sense of progress: 
evaluating wort( samples form all content areas; and teachers engaging in classroom research 
The docunwnt does not contain actual instnjments. 

Assessing Reading and Writing: Building a More Complete Picture, Sheila Valencia 
University of Washington, Seattle, WA 98195, 1989. (TC^400.3ASSREA) 

The author describes a procedure for devek>ping student portfolios of work in the areas of reading 
and writing. She advocates collection of responses to a number of tasks that vary along the 
dimensmns of focus (nf>echank» v. how well something achieved its purpose); stmcture 
(stmctured or naturalistic); locus of control (student self-assessment v. teacher assessment); and 
instrusiveness. Collecting a variety of outputs for various purposes in various task settings 
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enables one to get a broad picture of achievement. However, the author warns that the content 
of the portfolio has to be planned so that not everything >s included. She recommends three 
types of content - required (everyone assesses the same thing in the same way); semi-required 
(certain types of things are required, but exactly what is kept is up to the teacher and student), 
and open-ended (the teacher and/or student selects work that exemplifies the student's 
achievement). 

Dimensions for Looking at Children's Writings and Drawings, NOTE, 1111 Kenyon 
Road, Urbana, Illinois 61 801, 1976. (TC04OO.3DIMFOL) 

This rating forni is described by the author as an aid in the description of writing more than an aid 
in the evaluation of writing. Writings and drawings are described in terms of what is expi essed 
(themes, organization and range of vocabulary): the voice of the writer (stance, style, 
communication of individuality): and form (language use and mect>anics). The rating form is 
included. 

Multiple-Intelligences Go To School, Howard Gardner and Thomas Hatch, Educational 
Researcher, 18, 1989, pp. 4-10. (TC0O5O.6MUUNG) 

This article describes Gardner's theory of multiple intelligences an d three programs that are 
built on the idea of multiple intelligences. The authors propose that the implications for 
assessnf)ent of the theory of multiple-intelligences require the use of portfolios. The programs 
described use portfolios for assessing student progress and program evaluation. The document 
is descriptive only: no actual instmments are reproduced. 

North Carolina Assessment of Communication Skills, North Carolina Department of 

Education, 1 16 W. Edenton St., Raleigh, North Carolina 27603-1712, (919) 733- 
3703, 1989. (TC#400.3NORCAA) 

This handt>ook is designed tor use by classroom teachers in grades one and two to informally 
assess student progress on state curriculum goals in convnunication. There are three parts to 
the assessment procedure involving a series of checklists covering thinking skills, attitudes 
toward school, listening, silent reading comprehension, writing, speaking and oral language 
Checklists are included. 

Portfolio Assessment: Sampling Student Work, Educational Leadership, April, 1989. 
(TCM400 6PORASS) 

This artk;le briefly describes some approaches to using portfolios in instruction and to document 
student growth. The examples cited are in the area of writing. No instruments are included. 

Portfolio Evaluation: Room to Breathe and Grow, in C. Bridges (Ed.), Training the 
Teacher, Urbana, IL: NCTE, 1986. (TC047O.3POREVR) 

This paper describes a procedure for using portfolios to assess students in college composition 
classes. (It could also be adapted to high school.) The procedure encourages student self- 
evaluation - students choose samples of their own work to place in their portfolio and must 
provide justification for a grade they rc quest. 

Problem Solving Our Way to Alternative Evaluation Procedures, Janis Bailey, et al.. 
Language Arts, 65, 1988, pp. 364-373. (Taf400.3PROSOO) 

This article descrt>es several projects that resulted in 'meaning centered" checklists for reading 
and writing. Three checklists are provMed. 
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The Whole Language Evaluation Book, Portsmouth, NH: Heinennannn, 1989. 
(TC04OO.3WHOLAE) 

This anthology of essays by teachers and writing consultants explores a variety of Issues and 
approaches relating to whole language evaluation at the classroom level. Included are samples 
of self and peer-evaluation as well as teacher-directed evaluation ratings, checklists, anecdotal 
records and miscues. Broad topics include the theory and general principles of whole language 
evaluation, changes in evaluation through the grade levels, and evaluation of students who have 
writing difficulties. The major focus is on helping teachers make t)etter use of evakiation to 
understand their students, and on integrating whole language evaluation and instruction. 

Work Portfolio As An Assessment Tool For Instruction, Gat>e Della-Piana, Department 
of Educational Psychology, 327 Milton Bennion Hall, University of Utah, Salt Lake 
City, Utah 84112. 1989. (TC047O.3WORPOA) 

This is a draft paper which describes, in detail, a portfolio scheme for writing for grades K-8. 
included are layout, content and forms for the front and back covers. 

Assessment Alternatives in Mathematics, EQUALS, Lawrence Hall of Science, 

University of California, Berkeley, California 94720, 1989. (TC^500.6ASSALI) 

This document provides an oven^iew of some possitsle assessment methods in mathematics that 
cover both process and products. Specific examples are provided for writing in mathematics, 
mathematical investigations, open-ended questions, performance assessment, obser ations. 
interviews, and student self -assessment. Any of the student generated material could be self- 
selected for a portfolio of worit. The paper also includes a discussion of assessment issues and a 
list of probing questions teachers can use during instmction. 

Writing in Mathematics, J. Mumme, 10/89. frC05OO.3WRIINM) 

This paper lists 30 writing prompts to assess mathen^ticai problem so^ing ability. There are 
also a list of instructk)nal materials with a focus on writing, and a list of books and ariicles on 
writing in mathematics. 

Portfolio Assessment in Mathematics, Judy Mumme, California Mathematics Project, 
University of California, Department of Mathematics, Santa Barbara, CA 93106. 
1990. (TC05OO.6POPAMA) 

This paper covers the following topics, what a mathematics portfolio is. the purpose of portfolios, 
what should go into a math portfolio, suggestk)ns for the layout of the portfoin, how to select 
items for the portfolio, and some kjeas on evaluating portfoltos. An outline of criteria for 
evaluating portolios is provided, but not elaborated on. 

ARTS PROPEL as described in Opening Up Assessment, Dennie P. Wolf, Educational 
Leadership, January, 1988; and ARTS PROPEL, Educational Testing Sen/ice 
and Han/ard Project Zero. (TC081O.3ARTPRO) 

ARTS PROPEL is a cooperative research project concerned with arts educatton at the junior and 
senior high school levels. It is designed to devise &.«sessmei)ts of student learning whk:h are 
systematic, powerful and tuned to the central issues in artistic development. 

Portfolios, as used in ARTS PROPEL, have three parts. First is a comprehensive folder of 
student work during a course. Second, are targeted portfoik>s which contain worit selected from 
the folder by the student to convey certain aspects of learning and perlormance. Third, are 

5 



supplemental materials comprising such things as discussion notes, student seif-refiections, 
notes for ideas, etc. 

The associated article by Wolf elat>orates on the rationale for the portfolios and draws some 
parallels to other sut>ject areas. 

Anchorage Chapter I Student Portfolio, c/o Thomas Straugh, Anchorage School District 
P.O. Box 196614, Anchorage, AK 99519-6614, 907-269-2133, 1989. 
(TC4400.3ANCCHI) 

The Anchorage Chapter 1 Student Portfolio consists of several teacher checklists, a list of boolts 
read and writing samples. Checklists cover planning strategies (e.g., brainstonn, sot purpose, 
and consider audience): reading/Wrttlng strategies (e.g., reread, predict, summarize and retell); 
sharing strategies (e.g.. discuss, evaluate and ilhjstrate); listening behavtors and skills; speaking 
behaviors and skills: and reading behaviors and skills. 

The checklists are included, but the materials do not include descriptk>ns of ratk}nale or use 

Portfolio Assessment Clearinghouse, c/o San Diequito Union High School District, 710 
Encinitas Blvd., Encinitas, CA 92024, 619-753-6491, 1990. (TC^000.6SANDIP) 

The Portfolio Assessment Clearinghouse publishes the Portfolio News quaneriy. WinfiekJ Cooper 
and Jan Davies are the editors. Articles include descriptions of portfolio projects, statements 
concerning how and why portfolios could or should be used, reviews of literature, etc. 

Copies of the newsletter are included. 

Self-Assessment And The Mastery Of Writing, Edgar Thompson, in Testing In The 

English Language Arts, Michigan Council of Teachers Of English, P.O. Box 892 
Rochester, Michigan 48063, 1985, pp. 55-60. (TC4f470.3SELASA) 

This article lists six sell-reflective and evaluative questions that the author requires students to 
address for each paper they write. These cover self-reflection on the writing process, peer input 
and responses, strengths and weaknesses of the paper, what the student wants the teacher to 
look for in the paper, and what grade the paper shoukJ get. The questions and examples of their 
use are provided in the article. 

NWEA: Writing Portfolio Asessment Issues And Concerns, NWEA Writing Assessment 
Conference, October, 1989, c/o Allan Olson, Northwest Evaluation Association, 
P.O. Box 2122, Lake Oswego, OR 97035, 503-624-1951. (TC047O.6NWEWRP) 

This document is a summary of issues and concerns sun-ounding writing portfolio assessment 
generated at a writing assessment conference convened by NWEA in October. 1989. Issues are 
organized into the categories of management/togistics, assessment, purpose, cuniculum. and 
staff development. An operatnnal definition of a writing portfolk) is included. 
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Articles cataloged between 1/1/90 and 3/15/90 



Fairbanks North Star Borough School District Elementary Language Arts and Reading 
Assessment, Grades 1 and 5. Jim Villano. Fairt)anks North Star Borouah School 
Box 1250, Fairbanks, AK 99707-1250, 1969. (TC$400.3FAINOS) 

This document includes a package of instruments for assessing various aspects of reading and 
language arts acNevemenl at grades 1 and 5. In grade 5 there is a reading test consisting of 
long passages, multiple-choice <^estions and short responses; a scale for measuring attitude 
toward reading: a writing sample scored on six traits (Weas/Content. Organization/Development 
Voice/Tone/Flavor: Effective Word Choica; Syntax/Sentence Structure: Writing O^nventions) arid 
holistic ratings of listening and speaking. 

TTie grade 1 package includes a "writing sample' in which students prepare a pfcture story and 
then caption it; a scale for measuring attitude toward reading; a teacher rating of reading 
progress; and holistic listening and speaking ratings. 

Southwest Region Schools Competency-Based Curriculum •• Grades K-4 Janelle 
Cowan, Southwest Region Schools, Box 90, Dillingham, Alaska 99576 1989 
(TCIK)10.3SOURES) 

This is a draft curriculum document in which math and language arts objectives for grades K-4 
are presented in two forms: (a) as a teacher checklist; and (b) with an indicatfon of how to 
assess each objective. Objectives include listening, speaking, reading, writing, study skills, 
numeration, computation, problem solving, measurement and geometry. 

Southwest Regional Schools Teacher and Substitute Teacher Portfolios Janelle 
Cowan, Southwest Region Schools, Box 90, Dillingham, Alaska 99576, 1989. 
(TC^ 1 30. 4S0URES) 

There are two professional portfolios in this packet. The first is the Teacher Portfolio For The 
Improvement of Instruction. The teacher portfolio will contain several different types of 
information: 



A narrative written by the teacher that describes a personal plan for classroom activities 
that will support the mastery of school adopted objectives for the year. This narrative will 
be updated during the school year by adding progress reports, changes in goals, 
activities that relate to the goals, etc. 

Checklists completed by the site administrator at least four tinws a year that cover lesson 
plans, room organization, student participatton, instaictk>n, classroom control and 
recording of student progress. 

Four vWeotaped lesson presentations that are rated on various aspects of the clinical 
teaching model: reinforcement, anticipatory set. closure, modeling, motivation, active 
participation and retention activities. 



The second document is the Substitute Teacher Handbook and Inservice Guide used to select 
qualified substitute teachers. Substitute teacher applk:ants must first submit a persuasive letter 
that is rated on neatness, staying on the subject, imaginatton. sentences. rt)echank», and kJeas. 
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They also have to submit a vita. The remainder is a training manual on roles, responsibilities, 
class management, fire drills and requirements for submitting lesson plans. There is a substitute 
teacher self-quiz. 

Copies of all rating forms and checklists for both docunv*''': are included. 

Portfolio Assessment Across The Curriculum: Early Cor^flicts, Chris Anson, Robert 
Brown and Lillian Bridwell-Bowles, University of Minnesota. In NOTES from the 
National Testing Network in Writing, Vol 8, November 1988, Instructional 
Resource Center, Office of Academic Affairs, The City University of New York. 
535 E. 80th St., New York, New York 10021. (TC047O.6NOTERT) 

This article descrtMS attempts at the University of Minnesota to implement plans that require 
students to submit a cross-disciplinary portfolio of writing for entrance, and then to add to this 
portfolio during the college years. 

From Computer Management To Portfolio Assessment, Jackie Mathews, Orange 
Country Public Schools, Orlando, FL, The Reading Taacher, February 1990. 
(TC^440.6FROCOM) 

This article descnbes the basic design of a reading portfolio for grades K-2. The four core 
elements are: a reading development checklist, wn;:r)g samples, a list of books read by the 
student and a test of reading comprehension. Opi^'r?! elements include student self-evaluation, 
running reading records, audiotapes, anecdotal records, pages from reading logs, or other 
measures a teacher or student feels woukl illustrate the growth of the student as a language 
learner. 

The Reading Devetopment Checklist includes concepts about print, attitudes toward reading, 
strategies for word identification and comprehension strategies. (Some of the irxlividual items on 
the checklist are presented in the article.) The reading comprehension test is still under 
development. 

The various portions of the portfolio system have not yet been implemented. 

The article also describes other necessary components for an innovation of this type: 
administrative support, a climate for change, people expert in the area of reading, a good staff 
development program, and grass roots interest. 

What Makes A Good Teacher? Lee Shulman, Stanford University, Teacher Magazine, 
November 1989, pp. 35-36. (TC^I 30.4WHAMAA) 

This article descnbes an innovative teacher evaluation project at Stanford University. They are 
working on both teacher portfolios and teacher assessment centers. The assessment centers 
required teachers to deliver a lecture, plan a lesso . vith colleagues, and perform other tasks 
related to their subject area of expertise. 

In the portfolk) part of the assessment, teachers were asked to compile samples of their work that 
they thought reflected their best teaching -- lesson plans, videotapes and samples of student 
work. The portfolio included self-reflection. It is unclear from the article how these portfolios were 
evaluated for quality; however, the author did mention that they allow for differences in style. One 
drawback of the system is that it is time-consuming and most of the teachers in the project die' 
their portfolios on their own time. The author feels that this type of self-reflection should be built 
into the regular work-day. 
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The Professional Portfolio: Documentation of Prior Learning. Helen F. Marsh and 

Patricia A. Lasky, Nursing Outlook, 32, pp. 264-267, 1984. (TC094O.6THePRP) 

Atthough this article focuses on tie use of portfolios to document prior learning for nursing 
candidates, the principles discussed could apply to educators. 

The portfolio system described has two parts. The first is a narrative written t>y the carididate 
which describes prior learning experiences and provides evidence that concepts and princ^es 
from these fi>:periences are being applied in practice. The second part is documentacion that the 
learning experiences have talten place. IThis could include diplomas, transcripts, periormance 
ratings, employment records, worttshop certificates, test results, etc. 

To be nx)st effective, the categories of "expertise" to be demonstrated by the portfolio rrjst be 
laid out in advance, so that candidates know what the portfolio must show. Also, criteria for 
judging the portfolios must be established. 

Integrated Assessment System: Mathematics and Language Arts. Psychological 
Corporation, 555 Academic Court, San Antonio, Texas 78204-2498 512-299- 
1061, 1989. (TCM010.3INTASS) 

The Psychological Corporation will shortly have available portfolio packages for math and 
language arts for grades 1-8. The document cited above provides a brief outline of what those 
packages will be like. According to Psychotogical Corporatton. "a portfolio is a file or fokJer 
containing a variety of information that documents a student's experiences aiid 
accomplishments." Thus, this system appears to involve both formal and informal indicators of 
many aspects of performance. Included in the portfolio system are standardized test scores, 
curricukim transcripts, a list of awards and distincttons. student work samples, teacher rating 
scales and student self-evaluations. 

The language arts portfolio system includes portfolio folders for each student, a portfolio storage 
box. reading to write prompts, and teacher training matenals. There is a general scoring rubric 
having three areas: responses to reading (amount of information, accuracy of informatbn. and 
selection of informatton); management of content (organization/focus, devek>pment and 
accomplishment of task); and command of language (sentence stnjcture. word chowe and 
grammar/usage/mechanics) . 

The mathematics portfolio system is not described in this document. 

A Portfolio Approach To Classroom Heading Assessment: The Whys, Whats and 
Hows. Sheila Valencia, The Heading Teacher, Jan, 1990, pp. 336-340 
(TC^440.6APORAP) . hh 

In additton to discussing the rationale for using portfolk>s to assess reading, this artk:le also 
suggests content for reading portfolios, how to select material for a portfolio and how the portfolio 
should be organized. 

The ratnnale is. 1) sound assessmerrt is anchored in authenticity: 2) assessment rixjst be a 
continuous process; 3) valkl reading assessment must be multi-dimensional; and 4) assessment 
must provkle for active collaborative reflectton by both teacher and student. 

Content wouW include samples of the student's wortt. the teacher's obsen/atkinal notes, the 
student's own periodk; self-evaluation, and progress notes contributed by the student and teacher 
collaboratively. Specific items to be included would depend on the purpose for the portfolk) but 




incMjde such things as written responses to readioQ, reading logs, selected daily work, classroom 
tests, checklists, unit projects, audiotapes, 6;c. The idea is to have a variety of indicators. 

The real value of portfolios, according to the author, lies not in any single approach, txjt rather In 
the mind set that assessment is ongoing, and that periodic visits to the portfolio by the teacher 
and student are instmctionally essential. 

Adapting The Portfolio To Meet Student Needs. Margie Krest, English Journal, 79. 
1990, pp. 29-34, (TC047O.6ADATHP) 

This article was written by a high school writing teacher, tt provides some hints and ideas for 
using and adapting portfolios based on several years of use in her own dassrooms. Some of the 
ideas presented are: 

1 . She has students keep all their writing - drafts, revisions, prewriting n^terial, 
suggestions from classmates, and final drafts. This altows for collaborative discussion of 
such things as how well the student can incorporate other people's suggestions into their 
wortt, and student willingness to take risks. 

2. Not each piece of writing is graded. This encourages students to experiment. Grades 
are based on two scores - a portfolio score (reflecting the quantity of writing, and/or the 
arpount of revision, risk taking and changing they did on all their papers), and a 'paper 
grade" based on one to three final products (ones that have been conferred about, 
revised and edited thoroughly). 

The weight of these two components toward the final grade depends on the level of 
students and what they are working on. Sometimes the weighting for the two parts is 
decided collaboratively with the students. 

3. The frequency of assessment varies by grade and what is being worthed on. For 
exanrpfe, if the emphasis is on fluency, assessment might only occur after each quarier 
so that students have time to wori^ at becoming more fluent. 

4. Students are encouraged to continue revising a paper as many times as they want It 
can be regraded in subsequent portfolios. 

5. Most writing is based on free choice. However, the 'hor does require that all students 
do a minimum number of papers in various modes. .>e modes depend on the level of 
the student. For example, a college-bound student would be required to write a 
compare-contrast paper. These do not have to be among the papers that students 
choose to be graded. 

6. The major goal is to encourage students to take responsibility for their writing as much as 
possible - what to write about, how much revision will be done. etc. 

Portfolios Capture Rich Array of Student Performance. Pichard P. Mills, The School 
Administrator, Dec. 1989, pp. 8-11. (TC0O1O.6PORCAR) 




This article briefly describes Venront's plans to establish a portfolio system for state assessment 
in the areas of writing and mathematics. In addition to developing the portfolio content, logistics 
and scoring, plans include rethinking the state curriculum requirements, developing training 
materials for teacf)ers, using citizen advisory groups and reporting in ways that will promote 
discusston. 
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Portfolios Useful Assessment Tool. Education USA, Nov. 27 1989, 32, pp. 97-98. 
(TC0OOO.6PORU$A) 



This is a brief summary of presentations on portfolios made at the NCTE annual meeting in 1989. 
Four presentations are summarized: Jay Sugarman, discussing the use of portfolios for the 
improvement of teaching; Pat Belanoff . reviewing six years of experience using portfoltos in 
freshman writing classes: Barbara Morris, outlining the use of portfolios at the University of 
Michigan: and Michael Flanigan, emphasizing how using portfolios promotes teacher dialogue. 

Assessment In Whole-Language Classmoms: Theory Into Practice. Brian Cambourne 
and Jan Turbill, The Elementary SchoolJournal, 90, 1990, pp. 337-349. 
(TC04OO.6ASSINW) 

Although not formally labeling itself an article about portfolios, this docuiDent discusses how 
assessment is an integral part of instruction in whole language classrooms. As such, many of the 
suggestions presented relate to keeping performance logs of students. 

The authors define whole language instruction and describe the implications for assessment. 
Basically, the only real way to assess in a whole language classmcm is to observe and collect 
student performance and behavior as it occurs: this entails being an active participant in 
interactions with students. 

The paper then goes on to discuss five issues surrounding this type of 'naturalistic" assessment: 
1) when to record information; 2) how to record information: 3) what information to record; 4) how 
to make sense of the information collected: and 5) how to ensure the tmstworthiness of the 
assessment data. 

Appendixes to the article include examples of anecdotal records. 'mari<ers' that can be used to 
descrit>e a student's control of language, two checklists that teachers developed in order to 
summarize the observations they were making about students, and samples of teachers' 
narrative reports written for different audiences. 
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Articlos cataloged between 3/15/90 and 7/30/90 



NWEA White Paper On Aggregating Portfolio Data, Carol Meyer, Steven Schuman, 
Nancy Angello, Northwest Evaluation Association, 5 Centerpointe Dr., Suite 100, 
Lake Oswego, OR 97035, (503) 624-1951, 1990. (TC015O.6NWEWHP) 

This paper summarizes key issues and concerns related to aggregating assessment information 
from portfolios. TTie working definitton of "portfolto" used in this document is: 

'A portfoHo is a purposeful collection of student work that exNbits to the student (and/or 
others) the student's efforts, progress or achievement in (a) given area($). The collection 
must include student parttoipatton in selection of portfolk) content; the criteria for 
selection: the criteria for judging merit; and evkience of student self-reflection.'' 

The paper discusses a numtter of specific questtons in six major areas. These areas, and a 
sample of the questions discussed in each are: 

1 . The impact of 'newness" of portfolios on agggregating portfolio data. 

0 Are any portfolio projects well enough implemented as instoictional nrK)dels that 
sites exist for trying out potential aggregation methods/systems? 

o Do portfolio projects exist where aggregation of portfolk) data t>eyond the 
indivkJual level has occurred? 



Levels of aggregation of portfolio data 



o Is there a conceptual continuum of alternatives fcr aggregating portfolk) data? 

3. Potential conflk:ts for portfolios serving both purposes of instmction/individual 
assessment and large scale assessment. 

o Is there a concern of current and intended users of portfotos that large scale 
assessment needs will jeopardize the instmctional value of portfolios? 

o Will the aggregation of portfolio data force standardization of portfolios which 
directly conflkis with the desire for portfolios to be individualized? 

4. Potential benefits of portfolk s serving both purposes of instrudton/indivklual assessment 
and large scale assessment. 

0 Since wturt is assessed is valued, will the use of portfolk}s for assessment 
communicate a broader range of student perlormances whk:h are vakjed? 

o Can the use of portfolk>s for multiple assessment purposes eliminate redundant 
or 'add on" assessment/evakjatk>n activities? 



5. Using appropriate methodok>gy to aggregate portfolk) data. 

o Can aggregatton of portfolk) data occur if portfolk) contents, assignments, ratings. 

etc., have not been standardized? 
o Does adequate nwthodok)gy cunrently exist to aggregate portfolio data? 

6. Other issues relating to aggregating portfolk) data/ 
o Is aggregating portfolk) d?«ta cost effective? 
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Finding the Value in Evaluation: Self-Assessment in a Middle School Classroom, Linda 
Rief, Educational Leadership, March 1990, pp. 24-29. CrCM70.3FINTHV) 

This article presents a case study to illustrate why and how students shoukVcan chc<05e their own 
topics and genres for reading arxl writing: and how promoting seN-evaluation can add depth and 
meaning to learning. 

The author requires students to read at least 30 minutes a day and produce at least five rough 
draft pages of writing a weok. Periodically, the students are asked to rank their work from most 
effective to least effective and to evaluate it by consUenng the folk)wing questions: 

1 . What makes this your best piece? 

2. How did you go about writing it? 

3. What problems did you encounter? How dkJ you solve them? 

4. What makes your most effective piece different from you least effective piece? 

5. What goals did you set for yourself? How well did you accomplish them? 

6. What are your goals for the next 12 weeks? 

The author also describes classroom conditkins necessary to make the process work. 

Adapting Portfolios For Large-scale Use, Jay Simmons, Educational Leadership, March 
1990, p. 28. (TC047O.6ADOPOF) 

This summary bnefly describes a set of characteristrcs of portfolios that might be used as a better 
measure of student achievement than holistic ratings of single writing samples. 

The author requested 27 fifth grade students to select three samples of their best work for a 
portfolio. The students also wrote an explanation of why the pieces chosen were their best work, 
and wrote a timed essay . In addition to rating each piece holistically. the author also examined 
the collection of writings for: 

1. paper length, 

2. mode(s) of discourse, and 

3. correspondence between student's lists of the strengths represented in their papers and 
similar lists prepared by raters. 

The author found interesting correspondences between these factors and the holistk: ratings. 
The project will be repeated on a larger scale next year. 




Talking About Portfolios, Sandra Murphy arK! Mary Ann Smith, The Quarterly of the 
National Writing Proiect (Sprirjp 1990) and the Center For The Study of Writing, 
5513 Tolman Hall, school of tducation University of California, Berkeley, CA 
94720, (415) 643-7022. (TC0OOO.6TALABP) 

This articie uses examples of three portfolio projects to make the point that there is no such thing 
as The Portfolio, different groups end up with different portfolio systems depending on their 
purposes and what would best serve the local community of teachers and students. Prior to 
discussing the three examples, the authors mention various posstole purposes for portfolios and 
design considerations for portfolios. These are: 

1 . Purposes for por'.tolios could irKlude motivating students, promoting learning through 
reflection and self-assessment, evaluating or changing cunriculum. replacing or validating 
other tests, establishing exit requirements for coursewortc or graduation, tracking growth 
over time, and evaluating students' thinking and writirig processes. 

2. Design considerations include: 

a. Who selects what goes into the portfolio - students or teachers? 

b. What goes into the portfolio finished pieces, impromptu samples, work in 
progress, multiple drafts, particular domains of writing? 

c. How much shoukl be included? 

d. What might be done with the portfolios evaluation criteria, scored as a whole or 
each piece separately? 

e. Who hears about the results? 

f. What provisions can be made for revising the portfolio program? 
Examples used to illustrate the possible range of portfolio systems are: 

1 . Junior high students choosing writing from several different subject areas so that writing 
for different purposes and audiences can be examined. Students also include a letter 
explaining why they selected each piece and how they viewed themselves as writers. 

2. Ninth graders writing letters to their teachers discussing the strengths and weaknesses 
reflected in their portfolios. Teachers respond in writing and students then have a chance 
to respond again. 

3. Teacher interactkins that occur while examining and comparing student portfolios. 
The authors conclude that: 

1 . The benefits of portfottos lie as much in the discussk>n generated arTx>r>g teachers as with 
the formal inf conation they provide. 

2. Portfolios have their greatest impact when they become pari of the regular operation of 
the classroom. 

Mailing the Writing Portfolio Real, Kathryn Howard, The Quarterly of the National 
Writing Project (Spring 1990) and the Center For The Study of Writina, 5513 
Tolman Hall, School of Education University of California, Berkeley, uA 94720, 
(415)643-7022. (TC047O.6MAKTHW) 

The author was involved in devebping a portfolio process with the goal of reflecting students' 
views of themselves as writers. The steps in this process included: 
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1 . Establishing a climate in which students could freely express their feelings about their 
own writing and that of others. This entailed the oral sharing of writing, with question 
content, tone of voice and question phrasing initially modelled by the teacher. This 
developed not only an atmosphere of acceptance but also increasing depth in the 
analysis of each other's worlt. 

2. Asking students for written self-reflections. Students were asked to address two issues: 
Discuss one thing that is done well in your writing. Discuss one thing that needs to be 
improved in your writing. Student resporces were initially superficial, but gained depth 
with modelling and feedback. 

3. Asking students to choose, from their wortt fokJers. the writing that was of most 
'importance" to them. Students answered the following que$tk>ns: 

a. Why did you select this piece of wortc? 

b. What do you see as the special strengths of this wortt? 

c. What was particuiariy important to you during the process of writing this piece'' 

d. What have you learned about writing from your wori( on this piece? 

e. If you could go on worthing on this piece, what would you do? 

f . What particular skill or area of interest wouM you like to try out in future pieces of 
writing that stems from your worit on this piece? 

g. What kind of writing wouW you like to do in the future? 

4. l-laving students choose t>oth a satisfactory and an unsatisfactory piece of writing and 
analyzing the differences. A list of suggested questions is included. 

5. Having students finalize their portfolios for the year by reconsidering previous choices. 

This process resulted in increasing students' ownership of their work and relying on themselves 
and peers for assistarx^e in improving their worit. 

Thinking Together About Portfolios. Roberta Camp, The Quarterly of the National 
Writing Project (Spring 1990) and the Center For The Study of Writing, 5513 
Tolman Hall, School of Education University of California, Berkeley, CA 94720. 
(415)643-7022. (TC047O.6THITOA) 

The author discusses a collaborative effort in Pittsburgh to discover effective portfolio systems. 
The author first traces recent advances in research and practk;e that have lead to the search for 
innovative assessment practices. Then she discusses some of the results of the collaborative 
effort. Sonw of these inckjde: 

1 . An emerging "definitnn' of a portfolio which irtdudes: multiple samples of classroom 
writing, collected over a period of time: evklence of the processes and strategies that 
students use in creating at least some of those pieces of writing; and evidence of the 
extent to which students are aware of the processes and strategies they use and of their 
development as writers. 

2. Identification of characteristks that help create a classroom climate conducive to 
portfolios: student choice in their own wortt. reduced emphasis on 'rigfiA answers," and 
encouraging discovery and risk taking; creating a long-term view of classroom worit; 
student self-reflectk>n; and students becoming more active leamers by devetoping their 
own internal criteria for writing. 
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3. A portfolio system developed by a process that models the collaboration in learning that 
is desired in the classroom: teachers develop their ideas together through self-reflection. 

The author hopes that continuing conversations between teachers will lead to more consistent 
portfolios across classroorm as teachers develop a shared view of writing instruction; and will 
lead to more ideas on how to get students to choose pieces of work that do not in themselves 
show students to best advantage, but rather show how students have struggled with writing and 
learned from their struggles. 

Portfolio Assessment As A Means of Self-D'rected Learning, JoAnne T. Eresti, 
Pittsburgh Public Schools, Paper presented at annual conference of the 
American Educational Research Association, 1990. (TC047O.6PORASA) 

This paper describes the writing portfolio project in the Pittsburgh FHjbiic Schools. TTie content is 
very similar to that in the three papers presented above. The author's basic premise is that 
because of recent changes in our view of what education is and what writing is, the task of writing 
teachers becomes that of helping to support the self-leamer, the learner whose responsibility is 
ultimately his own for making meaning. The Pittsburgh project addressed both how to support 
such goals and how to assess them. The intent of their portfolio project is to support the self- 
discovery of the student as a writer. 

Although much of the paper describes the same process as the above three papers, there is 
some additk>nal detail. Specifically: 

1 . How the portfolio (i.'ocess is introduced to the students at the t}eginning of the school 
year. 



2. Additional examples of self-reflection questions. 

3. Additional information ?bout the final portfolio. 



Record of Student Performance, Community Experiences For Career Education. Inc., 
1 1850 S. W. King James Place, Tigard, Oregon 97223, (503) 639-8850. 
(TC^220.3RECOFS) 

Community Experiences For Career Education (CE)2 is an alternative high school program which 
offers students aged 1 6 through 18 a comprc ,'nsive secondary school experience through 
involvement on community and commerdai &..es. Students pursue a full-day leaming program 
designed to meet their individual academic and career devetopment needs. Students do not 
attend standardized courses, nor do they receive grades or time-bound credits. Successful 
completwn of the program qualifies the student for a standard high school diptoma. 

Student accomplishments are documented using a portfolio with certain specified elements. This 
portfolio is used for job application or educational placement. Content includes: 

1 . 'Certification of Student Pertomnance." This is a form that summarizes the projects, 
competencies, explorations, work experience, and basic skills completed by the student 
each year. Staff comments are included. 

2. More detail on accomplishments. This information is summarized on a series of forms 
covering basic skills, life skills, citizenship competencies, career development, and skills 
development. The forms are completed by various individuals including project staff, 
employers, and oorrvnunity workers. 
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Information might include the dates that various projects were completed (e.g., 
"legislature project. 4/18/74"): competencies that were demonstrated (e.g., "maintain a 
checking account, 9/25/73"); time spent exploring job options (e.g., 'city maintenance 
dept., 9/13/74'); and test scores. 

3. "School Placement Information.' This is a form which translates the previous projects 
into more traditional sut)ject area equivalent grades. 

4. Student comments. 

5. Letters of recommendation and transcripts from other places. 

Most of the information is descriptive of the tasks or peojects completed by the student. AKhough 
judgments of quality of student efforts are implied, there are no specified criteria for these 
judgments. 

The Senior Project, Jay Monier, Far West EDGE, Inc., 1817 Woodlawn Ave., Medford, 
Oregon 97504, (503) 770-9483, 1990. (TC^1 50.6SENPRO) 

This packet of papers includes an overview of the Senior Project, several articles written about it, 
and several pages from the Senior Project Student Manual. 

The senior project requires the foltowing: a research paper on a topic chosen by the student; a 
project that applies the knowledge gained during the research phase; and a 6-10 minute oral 
presentation about the research and project. Graduation depends on successful completion of all 
three parts of the Senior Project. 

The Senior Project Student Manual provaes assistance to the student on planning and carrying 
out the project. Only part of this manual is included in this packet. Included are documents for 
helping students to plan their project; and documentation and rating forms that must be included 
in the final Project Portfolio. The Coordinator's HandtXHJk contains instmctions for the oral 
presentation portion of the project. This document is not included in the packet. 

Video Report Cards Provide Comprehensive Evaluations, Don Sneedand Tim 
Wulfemeyer, Educator, Winter 1990, 44, pp. 50-56. (TC#150.6VIDREC) 

This article reports on pik}t testing video report cards for college journalism students. Each video 
was produced by the instructor and contained: 

1 . An overview of the course and the rationale for the video report card. This informatk>n 
was the same for each student. 

2. Excerpts from class activities - cl^s from fiekl trips, guest speakers, reviewed books, 
nx>vies, concerts, and art exhibits. This was the same for each student. 

3. Copies of graded papers with a discusston of the strengths and weaknesses of a 
student's writing, suggested areas that needed improvement, cited areas wtiere 
improvement had occurred, effective aspects, and identified problems with writing 
mechanics, story organizatton, informatk>n gaps, or unanswered questnns. This was 
indivklualized for each student. 

4. Other pertinent information such as late assignments, lack of effort, absenteeism, and 
perceived underachievement. This was individualized for each student. 



There was a generally favorable response frc>m the parents of students receiving these video 
report cards. 

The next set of documents were all generated as part of the teacher assessment and certification 
project at Stanford University. Two assessment approaches were examined: portfolios and 
assessment center exercises. The papers below discuss these snd the relationship between 
them. There are additional documents available from Stanford. 

Elementary Literacy Assessment Center Examiner's Handbook, Teacher Assessment 
Project, 1989, Stanford University, School of Education, CERAS507, Stanford, 
California 94395, (415) 725-1226. (Taif130.4ELEUA) 

The goals of the Assessment Center are to develop performance exercises to assess a teacher 
candidate's knowledge, skills and dispositions as a Board certifiable teacher of elementary 
literacy. This document is the manual used to train evaluators who rated teacher performances 
during the field test of Literacy Assessment Center exercises. 

The manual describes six performance-type exercises related to three strands: assessment of 
students, integrated language arts instnjction, and creating a literate environment.. Some of the 
exercises draw on literacy portfolios previously developed by the teacher candidates. Others are 
stand alone exercises that simulate teaching situations and are independent of the portfolio 
entries. 

Descriptions of the exercises and rating forms used to judge performance are provided. 

Portfolio Development Handbook for Teachers of Elementary Literacy, 1988, Teacher 
Assessment Project, Stanford University. School of Education, CERAS 507, 
Stanford, California 94395, (415) 725-1228. (TC013O.4PORDEH) 

This document is the handbook for grade 3 and 4 teachers to use in developing their own literacy 
portfolios in reading comprehension and compositk}n. For this purpose, a portfolio is defined as a 
collectton of documents that provide evidence of the knowledge, skills and dispositions of an 
elementary teacher of literacy. Specifications for portfolio entries include four items that relate to 
integrated language instruction, three that relate to creating a literate environment, and four about 
assessment of students. Teachers may also present an open entry and a reflective interpretation 
of any and all entries. The handt>ook provkfes guidance on what these entries shoukl be like and 
how to choose them. 

The docuHDents can take many forms, most of whk;h are produced as a normal part of teaching. 
The assessment center descrit>ed above provides the opportunity to examine the portfolio 
contents in depth. 

The School Teacher's Portfolio: Practical Issues in Design, Implementation and 

Evaluation, Teacher Assessment Project, 1988, Stanford University, School of 
Education, CERAS 507, Stanford, California 94395, (415) 725-1228. 
(TC013O.6SCHTEP) 

In additton to provMing a summary of the Teacher Assessment Project, this paper discusses 
many of the practical issues that were conskfered in designing, implementing and evakiating the 
schoolteacher's portfolk). 
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The Schoolteacher's Portfolio: An Essay on Possibilities, Tom Bird, 1988, Teacher 
Assessment Project, Stanford University, School of Education, CERAS 507, 
Stanford, California 94395, (415) 725-1228. (TC013O.6SCHTPO} 

Similar to the previous entry, this paper explores Issues and considerations surrounding teacher 
portfolios: problems associated with borrowing the notion of 'pottfoto' from other fields, 
purposes that a teacher's portfolio might sen^e, local arrangements in which portfolios might be 
constructed, and how portfolios might be fitted to the work of teaching. 

Thinking Out Loud: Proceedings of the Teacher Assessment Project Forum on Equity 
in Teacher Assessment, May 1988, Teacher Assessment Project, Stanford 
University, School of Education, CERAS507, Stanford, California 94395, (415) 
725-1228. (TC013O.6THIOUL) 

This paper presents the reactions of seven educators to the work-in-progress of the Teacher 
Assessment Project. 

Biolcgy Candidate's Assessment Center Handbook, May 1989. Teacher Assessment 
Project. Stanford University. School of Education. CERAS 507, Stanford, 
California 94395. (415) 725-1228. (TC013O.4TIOCAA) 

This handbook was designed to introduce teachers to the Assessnwnt Center exercises In 
biology. There are three types of exercises: extensions of portfolio information gathered 
previously, performance of tasks using the infomnation in the portfolio entry as a starting point, 
and stand-iitone exercises that do not use portfolio entries. The tasks involve interviews, written 
answers and computer responses. 

The individual exercises involve reviewing unit plans, discussing student evaluation, monitoring 
student laboratory work, analyzing altemative instnictional materials, reviewing a videotape of an 
instmctionai situation, adapting a textbook chapter to one's needs, using the computer as an 
instmctional tool, and discussing a teaching problem. The handbook describes these exercises 
and how performance will be evaluated. 

Notes On An Exploration Of Portfolio Procedures For Evaluating High School Biology 
Teachers, Tom Bird, 1989. Teacher Assessment Project. Stanford University, 
School of Education. CERAS 507, Stanford. California 94395, (415) 725-1228. 
(Taf130.4NOTONA) 

This article describes the work on portfolk>s done in the biok)gy component of the Teacher 
Assessnwnt Project through March. '.989. The preliminary content outlined for the portfolio 
inckjds seven "entries": a self-description of prevtous teaching background and cunent teaching 
environment: a unit plan; a tog of student evakjation procedures; a descriptton of a lesson in 
whk:h a textbook is substantially supplemented or replaced with other materials; a vkleotape of a 
laboratory lesson; a k>g of professional interacttons; and a tog of community interacttons. 
Candktates are given some chotoe as to whM:h of these to include. 

The artk:le describes these 'entries' in some detail, and adds informatton about consMerattons in 
developing them. 




Articles cataloged between 8/1/90 and 10/31/90 



Vermont Writing / assessment: The Pilot Year, Vermont State Department of Education, 
Montpelier. Vermont 05602, Falll 990. (TC^470.3VEBWRA2) 

The Vermont pilot will include grade 4 ar)d 8 students. Each student is to: 

1. Keep a writinp portfolio. Suggested minimum content of the writing portfolio include: a table 
of contents; a dated "best piece"; a dated letter explaining the choice of the best piece and 
the process of its composition; a dated poem, short story, play or a personal narrative; a 
dated personal response to a cultural, media or sports exhibit or event, or to a book, current 
issue, math problem or scientific phenomenon; dated prcse from a subject area other than 
'language arts." A sanrple of portfolios will be reviewed by a visiting review team using a 
fixed set of criteria. These criteria are included in the docunnent. 

2. Select a "best piece and write a letter about that piece." The can come from any class. A 
teacher can help a student select this piece. The best piece will be assessed using a set of 
four provided criteria. 

3. Write to a uniform writing prompt. 

An extensive bibliography on writing instnjction is included. 

Full-Day Kindergarten First Year Results. BillAuty, Corvallis School District, 1555S.W. 
35th St., Corvallis. Oregon 97333. 503-757'5855, Spring 1990. 
(TC#070.6FULDAK) 

This paper reports the results of a study of a lull-day kindergarten program for at-risk students. One 
part of this report contains representative samples of student writing from the beginning and end of 
the school year. Thus, the numerical infonnation in the repori is illustrated by actual student work 

Time to Replace the Classroom Test With Authentic Measurement, Alberta Journal of 
Educational Research, 36, 1990. pp. 78-84. (TC4lf470.6TIMTOR) 

This artrcle discusses the need for alternatives to standardized tests for use in the classroom. It 
briefly describes one possible 'record of achievement," or portfolio system. This requires that 
teachers set "good" writing tasks for students, preferably in cooperation with the students. 
Evaluation of individual entries is done cooperatively with the student. Grades may not be assigned 
to all entries. These records of student worit should also be used in parent conferences. 

What Makes A Portfolio A Portfolio? (Working Draft) Leon Paulson. Pearl Paulson, and 
Carol Meyer. Multnomah ESD. 11611 N.E. Ainsworth Circle, Portland, Oregon 
97220, 503-255-1841, Fall 1990. fTC^ISO.eWHAMAA) 

This brief artcie outlines the authors' percepttons of the characteristics that make the notion of 
portfolio assessment powerful. These characteristics are illustrated by samples from actual student 
portfolios. The eight characteristics are: 

1 . A portfolio must contain informatk>n that shows that a student has engaged in self-reflection 

2. Students must be involved in the selection of the pieces to be included. 

3. The portfolio is separate and different from the student's cumulative folder. 



4. The portfolio must explicitty or impiidtly convey the student's activities. 

5. The portfolio may serve a different purpose during the year from the purpose it senses at the 
end. At the end of the year, however, the portfolio may contain only materials that the 
student is willing to make "public.' 

6. A portfolio may have multiple purposes. 

7. The portfolio could contain information that illustrates growth. 

8. The slcills and techniques that are involved in producing effective portfolios do not happen by 
themse^es. Students need models of portfolios and how others develop and reflect upon 
them. 

The School Of Hard Knocks: A Study on the Assessment of Experiential Learning. 
Summary Report, Peter Thomson, TAFE National Centre for Research and 
Development, Payneham, Australia, 1988. ERIC ED 295 033. For full report see 
ERIC CE 050 244. Full report also available from Nelson Wadsworth, P.O. Box 
4725, /Melbourne, Victoria 3001, Australia. (TC^I 50.6THESCO) 

This article descnbes a process for assessing adult learners' life experiences for the purpose of 
granting them exemptions from formal course woitt. Applicants are assessed using portfolios, 
structured interviews, and on-the-job ratings. The first two are rated by a three-person panel with 
expertise In the area to be assessed and training in how to assess the portfolios and interviews. 

The portfolio contains an autobiographical nanative, a statement on special competencies, 
assignments set by a tutor, wotk samples, testinnonials, and references. These are assessed by 
checking the relevance of competencies claimed against course outcomes and objectives The 
inten/lew is structured and is assessed by using a checklist. 

If provisk)nal exemptton from coursework is granted by the assessment panel, assessment of 
performance continues on the job in a variety of ways, depending on the area These could include 
k>gs, supervisor ratings, oral tesis, etc. 

Exemption is finalized on the basis of successful progress through all the atxjv^ stages. The 
summary document does not contain the actual checklists used. 

Coding Journal Entries, Janice Evans Knight, Journal of Reading, 34, 1990, pp. 42-47. 
(TC#440.3CODJOE) 

This article describes a system for coding reading journal entries to pronx>te student self-reflection 
and improve reading strategies and comprehension. The impetus for this system came from the 
author's obsen^ation that many reading journal entries were only superficial summaries of what was 
read. 

Each journal entry is coded by the student and/or teacher as to the level of thinking, metacognitive 
strategies, and confusion the entry indicates. Examples of these three sets of codes are: 

1 . Level of thinking. Examples of codes hare are "R" which means "recall." and " " which 
means inference, predictk>n, or cause and effect. 

2. Metacognitive strategy. Examples are "S* which means "summarize," and "SO" meaning 
"self-questk>ning." 
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3. Confusion. Examples are "0" meaning that the entry does not say anythlr^i significant, and 
*?* meaning that the entry indicates student confusion . 

Ttie power of this system is that the coding systerii is integrated with instruction so that stLidents 
learn what good reading strategies are and then assess their own journal entries. 

Portfolio Transfer System, Linda Lewis, Ft. Worth Independent School District, 3210 W. 
Lancaster, ht Worth, Texas 76107, 1990. (TC015O.6PORTRF) 

This document is a wording draft describing the portions of student writing portfofios that should be 
transferred from one teacher to the next in grades 1 -6. 

How Do Portfolios Measure Up? A Cognitive Model for Assessing Portfolios, Leon 
Paulson and Pearl Paulson, Multnomah BSD, 1 161 1 N.E. Ainsworth Circle 
Portland, Oregon 97220, 503-255-1841, Fall 1990. (TC015O.6HOWDOP) 

The central consideration in this paper is how to design procedures for aggregating information from 
portfolios while preserving the integrity of the portfolio for instructional purposes. They propose that 
what needs to occur in order to aggregate is not the standardization of the specific pieces in the 
portfolio (e.g., an attitude checklist, one piece of persuasive writing, etc.). but a clear idea of the 
rationale for the portfolio, what processes or outcomes are to be demonstrated by the portfolio, and 
the standards or criteria for judging success. The actual exhibits can vary 

The authors propose that portfolios can l)e described along three dimensions; 

1 . Activity - the operations involving putting together portfolios. This includes the rationale for 
the portfolio, the areas to be covered by the portfolio, the specific content to be in the 
portfolio, performance criteria for students, and how judgements will be made by students 
and/or evaluators. 

2. History -- antecedents to the wort< in this year's portfolio and how the portfolio will be used in 
the future. This includes individual student baseline performance, learner characteristics 
and context; the encounters that occur around the portfolio itself; and the final status of 
student pertormarice. 

3. Stakeholders -- those individuals with an interest in the portfolio. These could include 
students, teachers, parents, and aggregators. 

Several examples are presented that relate these dimenstons to actual portfolio projects. 

Pilot Project For Portfolio Assessment, Linda Lewis, Fort Worth Independent School 
District, Fort Worth, Texas, August 2, 1990. (TC^470.3PILPRF) 

This paper describes a staff development exercise in which teachers brought six student writing 
foWers and looked through them to answer the question: "If someone came into your room and 
wanted evidence of student growth in writing in ten specified areas. wouM your student fokiers 
provide this evWence?" The ten areas were district writing goals. The list of these ten goals is 
irKluded. 

Lewis & Clark College New Admissions Initiatives, Susan Resneck Parr, Vice President for 
Academic Affairs, Lewis & Clark College, Portland, Oregon 97219, 503-293-2653, 
1990. (TC4f000.6LEWANC) > ^ . 
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Lewis & Clark Colege now offers two alternative options for admissions - portfolios and a Saturday 
Seminar. The portfolio option requires that students sut)mit materials which demonstrate that they 
meet the college's criteria for admission. Suggestions are: 

1 Prcxhjcts that demonstrate intellectual growth and an at>ility to write clearly and thir* 

critically. These could inchjde. for example, a series of papers or tests that show growth; or 
science projects, mathematical proofs, computer programs, audio tapes of perfonuances. 
etc. to show accomplishment of advanced skills. 



2. An official high school transcript. 

3. A letter from a high school counselor or principal certifying that the wort* is one's own 

4. Three sealed letters from recent teachers assessing one's academic abilities. 

5. The first page of a standard admissions application. 

6. Other pertinent information such as standardized test scores, additional recommendations 
from teachers and others, a statement of academic goals and interest, and an admissions 
essay. 



The Saturday Seminar for Eariy Decision is designed for students certain they wish to become Lewis 
& Clartt students. The program includes a weekend visit. partk;ipation in a seminar, an interview with 
an admissions counselor, an opportunity to talk to a financial sen/ice counselor, and invitations to 
social events. They also must submit either a regular admissions application or a portfolio. 

In the materials we obtained there is no discussion of how portfolio or seminar performances wouki 
be assessed. 

Assessment Principles. Grant Wiggins. CLASS Training Materials. 56 Vassar. Rochester 
NY 14607. 716-244-8538. 1990. (TC^150.6ASSPRI - Available only from author). 

This document is an excerpt from training materials used by Grant Wiggins. It includes the defining 
characteristics of "authentic" assessment, princip'ss for designing good performance assessments. 
28 examples of performance assessment tasks from various school districts and state departments 
of education, and 15 examples of scoring procedures. Please contact the author for additional 
information. 

An Individualized Management Strategy for Secondary Reading Teachers. Richard Hays 
Paper presented at the Annual Meeting of the fndiarta State Council of the 
International Reading Association, 1987. Also ERIC ED 285 140 
(TC^440.6ANINDM) 

This paper discusses a management effectiveness strategy that can be errployed by secondary 
classroom reading teachers to facilitate and improve learning by those students whose reading skill 
needs are severely deficient. The strategy includes assessment, foklers, individualized prograrre. 
mini-group lessons and scoring. 

The folder is student nwnaged and includes: the available materials for the student to use to team 
certain skills: a percentage chart so that students can comp jte their own percentage of accuracy on 
each tesson; a progress chart for each skill so u;?t student? can see their progress; an evaiuatkm 
sheet that lists the requirements to be met by the stuAini; and other material as needed. Students 
and teachers evaluate (score) the wortt and plot progress. 
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Articles cataloged otween November 1, 1990 and January 31, 1991 



Child as Coinvestigator: Helping Children Gain Insight Into Their Own Mental 

Processes, Mariene Scardamalia and Carl Bereiter, in S.G. Paris, G.M. Olson & 
H W Stevenson (Eds), Learning and Motivation In The Classroom, Hillsdale NJ: 
Earlbaum, pp. 61-82, 1983. (TC0O5O.5CHIASC) 

Toe main purpose of having this paper In the bUiogrpahy is to help define metacognilion. The 
paper provides a variety of ideas on how to help students become more aware of their mental 
processes. The pu»pose is not to enable people to develop a "course" m metacogniticn, but 
rather \o design regular activities to h€lp bring mental processes out into the open. 

The topic of metacognltion is important when discussing portfolios because many individuals feel 
•hat the process of self-reflection is integral to assembling portfolios. Additionally, taxonomies of 
metacognitive skills may be useful to develop criteria for assessing the self -reflections of 
students. 

Vermont Mathematics Portfolios 0990), Vermont State Department of Education, 
Montpelier, VT 05602. (TOfSOO.SVERMATP) 

n This document describes the portfolio pilot currently being conducted by the state of Vermont in 

1 grades 4 and 8. Criteria for evaluating portfolio entries include three general areas: Task 

Performance (understands the problem, chooses strategies, carries out procedures, and verifies 
results): Communicatwn (expresses thinking, expresses self -reflection, uses appropriate 
mathematical language/notatton); and Mathematical Empowerment (motivation, curiosity, 
perserverance, risk taking, flexibility and self confWence) 

A sample of portfolios are examined for evidence of student growth, emphasis on concept 
development, devetopment of group problem solving skills, integration of mathematics into other 
currfculum areas. applk:atk)n of math to real-worid experie ices. and making math connections 

Put Portfolios To the Test, Linda Vavrus, Instructor, August 1990. (TC^I 50.6PUTPOT) 

This paper is designed to be an introduction to the use O; portfolws. The author defines a 
portfolk) as a "systematic and organized collection of evidence used by the teacher and studont 
to monitor growth of the student's knowledge, skills, and attitudes in a specific subject area." 
There is a brief discussion of the foltowing topfcs: What will it took like? What goes in? How and 
when to start? Evakjating portfoltos; and Passing Portfolios On. While there are a few concrete 
examples, most of the artk:le is a list of questtons that must be addressed when setting up a 
portfolk) system. 

The paper also mckJdes a short inten/iew with Grant Wiggins. His definition of a portfolio appears 
to include the requirement that portfoltos represent students' best wortt. 

The Role of Metacognltion in English Education, Jill Wilson, English Education, 17(4), 
December 1985. (TOfOSO.SROLOFM) 

Although not strictly about portfoltos. this arttole is included because of the general feeling that 
portfoltos shouM require some degree of student self-reflection, and shouM b9 analyzed for 
evWence of student metacogntton. This arttole helps define what metacogntton is and provtoes 
examples of how to teach metacognitive skills. The basto defintton of nrtetacognitton in the article 
is "knowledge and control of one's own cognitive processes." 
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Guide For Developing Student Portfolios, D. Roettger and M. Szymczuk, Educational 
Services, Heartland Area Education Agency 1 1, 6500 Corporate Drive, Johnston, 
lA 50131, 1990, (TC047O.3GUIFOD) 

This guide was developed to sumn\arize the experiences of a group of teachers who spent a year 
using portfolios to assess and document student learning. A portfolio is defined as "a collection 
of evidence used by the teacher and student to monitor the growth of a students lax>wledge of 
content, use of strategies, and attitudes toward the accomplishment of goals in an organized and 
systematic way.' There is assistance with planning for the portfolio, writing goals for students 
that reflect what they should kpow and be able to do. planning for integrating assessment and 
instnjction, setting standards, and ways to document student growth. 

This document is prepared mainly for training purposes, and emphasizes questions that teachers 
should answer for themselves while they are insegrating assessment and instruction. The 
document does not illustrate how these questions were answered by this group of teachers For 
example, the document does not include any of the following: actual goals written by the 
teachers: an outline for the content of a portfolio: specific suggestions on how to integrate 
assessment with instmctioii: or actual criteria for evaluating portfolios as a whole or individual 
products within portfolios. 

Rational Numbers: Toward Grading and Scoring That Help Rather Than Harm 
Learning, Grant Wiggins, American Educator, Winter 1988, pp. 21-46. 
(TC»1500.6RATNUM) 

This article presents a discussion of the need to have clear criteria for both grading and testing 
These critria essentially define what we value in student work. This not only improves 
consistency in assigning grades or rating performance, but also ensures nx>re clarity for students 
on expectations and communicates more effectively what to do if performarice is not satisfactory 
Tii9 author presents several examples of criteria. These examples include: seven general 
criteria for any course of study, oral presentations, writing, and science. The author also 
discusses ways of making grading unifoon across teachers and different grading approaches 

Although not directly about portfolios, this article reinforces the need to have criteria for evaluating 
portfolios. These criteria must make public what we value so that we know what to teach, 
students can evaluate their own work, portfolios can t>e assessed. 

From Folders to Portfolios (A Skit), Carol Meyer. Northwest Evaluation Association, 5 
Centrepointe Dr., Guite 100, Lake Oswego. OR 97035, (503) 624-1951. 1990. 
(TC^150.6FROFOT) 

This skit is a lighd-hearted way to define what is meant by a portfolio and to higr<ight the 
differences between folders and portfolios. 

Math Learning Center, Recommendations For Assessment, Visual Mathematics, 1989. 
(Full reference not available. TC4f500.3RECFOA) 

This document is part of a longer monograph. Unfortunately, the longer source was not noted in 
the version we obtained. The exerpt briefly discusses using writing activities, checklists, quizzes, 
interviews, and self-evaluation to assess mathematics. The appendices contain a list of writing 
activities, joumal exercises and starters, a ct^cklist covering important dispositions, interview 
suggestions, and self-evaluation activities. 
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Portfolio Project at Kraxberger Middle Sctiool, Mary Kilmer, Portfolio Assessment 

Newsletter, 2(2), December 1990. Also contact Mary Kilmer, Kraxberger Middle 
School, 17777 Webster Road, Gladstone, OR 97207, (503) 655-3636. 
(TC0OOO,6PORPRA) 

This article is a brief description of one teacher's experiences in assisting students to assemble 
their own integrated portfolios in grades 5-8. The portfolio can contain any work; all worK is self- 
selected by the student. At the end of each quarter the portfolio is cleaned out, and final 
selections are made. The teacher assists the students to reflect on the reasons that the student 
has for selecting each piece that will remain. Questions irKtude: 

1 . What makes this selection better than any other work you did this quarter? 

2. What might you have done differently to irrprove this project? 

3. Think back to all the steps and procedures involved in making this a project to be proud 
of.. ..what would you offer, in words, as evidence that it was a valuable use of your time'> 

4. Anything else? 

Curriculum Alignment System Comprehensive Assessment System (CAS^), Joseph J. 
Kirkman, School Research and Service Corporation. P.O. Box 4890, Laguna 
Beach, CA 92652, (714) 497-7426. (TC04OO.3CASCAS) 

This document is a set of handouts from a presentation by Susan Holmes at the California 
Educational Research Association meeting in Santa Barbara, November 1990. As such, it only 
outlines in a general way the CAS^ project. CAS^ is a consortium effort by a group of 30 districts 
in California to assemble portfolios as part of innplementing whoie language instnjction. The 
current specifications for the portfolio call for various types of items to be collected at various 
times of the school year. Portfolio items inciude timed writing samples, various self-selected 
writing pieces, a reading list, and other integrated tasks (undefined in this document) A three- 
trait analytical scoring rubric for writing is included • rhetorical stance, coherence, conventions 
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Summary of Assessment Instruments in Speaking and Listening 

From: Assessing Communication Competence in Speaking and Listening 
by Judith A Arter. Ph D , Portland. OR: Northwest Regional Educational laboratory, igoo 
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CRITERIA FOR DESCRIBING, SELECTING AND REVIEWING 
ASSESSMENT TOOLS IN SPEAKING AND LISTENING - 

SUMMARY 



Criterion 1: Content 

W« will describe: 

1 . The purpos«3/uMt the author planned for the instrument. 

2. General infonnatien about the instrument such as the grade ievets intended for use. number of 
levels, fornis and items, test length, and administration requirements (training, equipment. 3tc.). 

3. The task presented to the student, including the purpose, setting and audience for the 
communication, as wetl as the specific content presented to studenu and the skHls the assessment 
is trying to cover. With respect to skills, we wNI IrxJicate bath the extent to which the assessment 
tool emphasizes linguistic versus communication competence and the specific skills covered. 

4. The responaet by which the student demonstrates his or her level of skii!. 

5. Who scores the responses or perfonnances anc< the crtteris by which they are scored. 

The rating in this area will depend on how well materials accompanying the instrument provide the 
infomnation necessary for users to match the instrument to their needs. 

Excellent The developer includes information on purposes, the population 

recommerxJed for use. and limitations of the instrument for tne use 
suggested: describes how the instrunrwnt could be used with atypical 
populatk>ns.- defines measurement terms and uses language appropriate 
for the user, lisu specialized skills needed to administer the instrument: 
describes the test development process: provkles information on 
reiiabiiity and valkllty: and provides samples of questions, directions, 
answer sheets, manuals and score reports (Joint Committee On Testinp 
Practices. 1988). 

Good Much of the information above is provided. 

Fair Some of the infonnation above is provided. 

Poor Little of the infonnation above is provkJed. 

Criterion 2: Reliability 

We will use the following criteria for judging the general adequacy of the reliability of instruments: 

Excellent Reliability of total test score .95 or above: reliabilities of subtest scores 90 

or above. 

Good Reiiabiiity of total test score .65>.94: reliabilities o^ subtest scores .80 and 

above. 

Feir Reliability of total test score .75- 84: reUbilities of subtest scores .65 and 

above. 

^oor Reliability of total test score .74 or below; reliabUities of some subtest 

scores below .64. 



ERIC Unknot* No information Is provided. 



Criterion 3: Validity 



In the ravitws of instrumwit*. wt di»crib« th§ typM of validity con$id§f«tions and studitt carriwl out by 
th««uthor(s). Thl»indud«tdl8CUMtoniolcortintcr1ttrton«ndcor«f^ B«c«um th«y relate 

most dlrectt>' to spMking and we wiN pay particular attention to the validity laMjee dl««t»ed in 

the previous chapter extent ol sampUng from contexts. artWdal v. naturalistic tasks, assessing skHls In 
isolation or In concert tasks that require extraneous sWHs. sources of l)las, degree of realism m the task 

and response, extraneous skHs required for responding, correspondence between the task and sconng 
criteria, rater effects, and ecoiogtoal validity. 

For purposes of this Guide, ratings in the area of validity will be: 

There are many lines of evidence presented that the instn:ment measures 
what is claimed and can be used for the purposM proposed. 

Several lines of evidence are presented and these provide convincing 
evidence. 

At least one study was completed and this provides convincing evidence 
Evidence that is provkjed is not convincing. 
No evklence is provided. 



Criterion 4: Help With Interpretation and Use 

Ratings in the area are: 

Excellent There are norms that are based on a large, representative sample of an 

appropriate reference group of ^udents or there arc other usafui 
standards for compartson (e.g.. perfonnance of venous groups or 
judgments of mastery); there is help in how to use the results in 
instruction; there is a discussion of the possible uses and misuses of 
results; there sre good score reports and they sen/e the intended use 

Good There are appropriate nonms and /or other standards of companson 

There is discussion in at least one other area mentioned above 

Fair There is good assistance in at least one of the areas mentioned above. 

Poor The assistance that is provtied is judged seriously lacking. 



Excellent 

Good 

Fsir 

Poor 

Unknown 



Unknown 



No Information is provkled. 



